00000001:02000400:0.0F:1784937900.426394:0:2978:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_hostid 00000001:02000400:0.0:1784937917.768979:0:3198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000001:01000000:3.0F:1784937919.541827:0:3259:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 972 MB/s 00000001:01000000:1.0F:1784937919.792039:0:3259:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 795 MB/s 00000001:01000000:3.0:1784937920.041273:0:3259:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5823 MB/s 00000020:02000000:0.0:1784937920.800911:0:3291:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_203_ga89eac3 00000400:02000000:1.0:1784937921.815107:0:3305:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.158@tcp [8/256/0/180] 00008000:02000000:1.0:1784937925.184110:0:3454:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1784937974.702058:0:5260:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1784937984.728171:0:5786:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784937984.728177:0:5786:0:(obd_mount.c:922:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1784937984.728422:0:5786:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 000000004a825f35 00000080:02000400:3.0:1784937984.728433:0:5786:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1784937984.739252:0:5786:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1784937984.739267:0:5786:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784937984.739309:0:5786:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (0000000090777162) 00000020:00000080:3.0:1784937984.739332:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0F:1784937984.807771:0:5786:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1784937984.812681:0:5786:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1784937984.871848:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1784937984.871890:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784937984.871914:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784937984.871967:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784937984.871995:0:5786:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784937984.874791:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1784937984.874803:0:5786:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784937984.874817:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec33bf 00000020:01000004:1.0:1784937984.874826:0:5786:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:1.0:1784937984.874831:0:5786:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1784937984.874836:0:5786:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004a825f35 from MGS 00000020:01000004:1.0:1784937984.874840:0:5786:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1784937984.874859:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000db7e8c6c) 00000020:00000080:1.0:1784937984.874870:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1784937984.874970:0:5786:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004a825f35 from MGS, refs=2 00080000:01000000:1.0:1784937984.874976:0:5786:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1784937984.874981:0:5786:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec33cd 00000100:00100000:1.0:1784937984.875088:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1784937984.879397:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1784937984.879412:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1784937984.883723:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1784937984.883737:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1784937984.885155:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784937984.885478:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1784937984.885485:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1784937984.886413:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1784937984.886421:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1784937984.887413:0:5786:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1784937984.887422:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1784937984.887979:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784937984.887983:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784937984.887984:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937984.888756:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937984.888760:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937984.888762:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937984.889530:0:5786:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784937984.893182:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1784937985.139789:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2127 MB/s 00000001:01000000:3.0:1784937985.389261:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3319 MB/s 00000001:01000000:1.0:1784937985.646564:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 595 MB/s 00000001:01000000:3.0:1784937985.898953:0:5786:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 539 MB/s 00010000:00010000:2.0:1784937985.905840:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784937985.908839:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1784937985.943752:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1784937985.943772:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784937985.943776:0:5786:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1784937985.946444:0:5796:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1784937985.946661:0:5786:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1784937985.946723:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1784937985.946991:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784937985.947021:0:5786:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784937985.950033:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784937985.950308:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784937985.950322:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1784937985.954014:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1784937985.954028:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784937985.954865:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784937985.954873:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1784937985.961538:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1784937985.961574:0:5786:0:(obd_mount.c:414:lustre_start_mgc()) Start MGC 'MGC192.168.201.158@tcp' 00000020:01000004:1.0:1784937985.961576:0:5786:0:(obd_mount.c:423:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1784937985.961637:0:5786:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGC192.168.201.158@tcp (typ=mgc) 00000020:00000080:1.0:1784937985.961650:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.158@tcp (0000000014856dbc) 00000020:00000080:1.0:1784937985.961670:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1784937985.961762:0:5786:0:(ldlm_lib.c:125:import_set_conn()) imp 00000000bde68ee3@MGC192.168.201.158@tcp: add connection 0@lo at head 00010000:00010000:1.0:1784937985.961926:0:5786:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.158@tcp-0 is initialized 00000040:01000000:1.0:1784937985.961951:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 1 is initialized 00000100:00080000:1.0:1784937985.962274:0:5800:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1784937985.972812:0:5802:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784937985.977391:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.158@tcp (uuid f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18) 00000020:00000080:1.0:1784937985.977423:0:5786:0:(genops.c:1406:class_connect()) connect: client f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18, cookie 0xea86628a8aec33db 00000100:00080000:1.0:1784937985.977436:0:5786:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784937985.977442:0:5786:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import 00000000bde68ee3 using connection f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18/0@lo 00000100:00100000:1.0:1784937985.977505:0:5786:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001be64d23 x1871643065450624/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784937985.977530:0:5786:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS 00000020:01000004:1.0:1784937985.977550:0:5786:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784937985.977555:0:5786:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784937985.977570:0:5786:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000442469bd) 00000020:00000080:1.0:1784937985.977581:0:5786:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1784937985.984488:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001be64d23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3320:1871643065450624:0@lo:250: 00000100:00100000:0.0:1784937985.984581:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937985.985207:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065450624 00000100:00100000:2.0:1784937985.985241:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065450624 00000100:00100000:2.0:1784937985.985302:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784937985.985308:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a91d4d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3320:x1871643065450624:12345-0@lo:250: 00010000:00080000:2.0:1784937985.985338:0:5797:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18@0@lo t0 exp 0000000000000000 cur 194 last 0 00000020:00000080:2.0:1784937985.985371:0:5797:0:(genops.c:1406:class_connect()) connect: client f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18, cookie 0xea86628a8aec33e9 00000100:00080000:2.0:1784937985.985510:0:5797:0:(import.c:65:import_set_state_nolock()) 00000000fe665c36 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784937985.985578:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a91d4d88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:3320:x1871643065450624:12345-0@lo:250: Request processed in 269us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937985.985586:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784937985.986399:0:3320:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1784937985.986412:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.158@tcp: connect to target with instance 0 00000100:00080000:0.0:1784937985.986420:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1784937985.986426:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1784937985.986430:0:3320:0:(import.c:65:import_set_state_nolock()) 00000000bde68ee3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1784937985.986433:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1784937985.986441:0:3320:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1784937985.986447:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001be64d23 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3320:1871643065450624:0@lo:250: 00000100:00100000:1.0:1784937986.000918:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784937986.003852:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784937986.003863:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784937986.004893:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784937986.004903:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1784937986.005548:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784937986.005561:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784937986.006548:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784937986.006942:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784937986.006948:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784937986.007956:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784937986.007965:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784937986.087860:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784937986.088065:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784937986.088072:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1784937986.091955:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1784937986.091976:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784937986.092900:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784937986.093104:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784937986.093117:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1784937986.093777:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784937986.093786:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1784937986.094372:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784937986.094528:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784937986.094540:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1784937986.095018:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784937986.095025:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1784937986.095660:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784937986.095796:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1784937986.095801:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1784937986.104469:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1784937986.104493:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1784937986.152095:0:5786:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784937986.152418:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1784937986.152433:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784937986.154759:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784937986.154775:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784937986.155701:0:5786:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784937986.155712:0:5786:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784937986.157186:0:5786:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784937986.157211:0:5786:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784937986.157242:0:5786:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784937986.157404:0:5786:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784937986.157443:0:5786:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1784937986.157448:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784937986.157450:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784937986.157452:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784937986.157453:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784937986.157457:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784937986.157459:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784937986.157460:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784937986.157461:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784937986.157462:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784937986.157464:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784937986.157465:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784937986.157466:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784937986.157468:0:5786:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1784937986.157470:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784937986.157471:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784937986.157472:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784937986.157473:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784937986.157474:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784937986.157475:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784937986.157475:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784937986.157476:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784937986.157477:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784937986.157478:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784937986.157478:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784937986.157479:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784937986.157519:0:5786:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784937986.157540:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000109221f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065450752:0@lo:253: 00000100:00100000:3.0:1784937986.157633:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937986.157687:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 0000000017d98878 going to sleep for 11 seconds 00000100:00100000:2.0:1784937986.157777:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065450752 00000100:00100000:2.0:1784937986.157791:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065450752 00000100:00100000:2.0:1784937986.157833:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784937986.157841:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fefb75b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5786:x1871643065450752:12345-0@lo:253: 20000000:01000000:2.0:1784937986.157890:0:5799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1784937986.157894:0:5799:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1784937986.158362:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1784937986.158422:0:5799:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:2.0:1784937986.158750:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784937986.159682:0:5821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1784937986.159946:0:5799:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1784937986.159952:0:5799:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1784937986.159959:0:5799:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1784937986.159963:0:5799:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1784937986.159979:0:5799:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1784937986.160200:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784937986.160504:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1784937986.160518:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1784937986.160567:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1784937986.160612:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1784937986.160642:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1784937986.160723:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1784937986.160731:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1784937986.160767:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1784937986.160774:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1784937986.160798:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1784937986.160804:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1784937986.160828:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1784937986.160867:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1784937986.160890:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1784937986.160895:0:5799:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1784937986.160904:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784937986.161079:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1784937986.161102:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1784937986.161134:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1784937986.161165:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1784937986.161206:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1784937986.161243:0:5799:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1784937986.161309:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1784937986.161316:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1784937986.161370:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1784937986.161417:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1784937986.161449:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1784937986.161458:0:5799:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1784937986.161530:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1784937986.161538:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1784937986.161565:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1784937986.161592:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1784937986.161743:0:5799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1784937986.161792:0:5799:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1784937986.161800:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1784937986.162699:0:5822:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1784937986.163017:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1784937986.163127:0:5799:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.158@tcp for mdt 20000000:01000000:2.0:1784937986.163130:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:2.0:1784937986.163168:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1784937986.163175:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1784937986.163199:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1784937986.163205:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:3.0:1784937986.163523:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1784937986.163549:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1784937986.163584:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1784937986.163622:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1784937986.163698:0:5799:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1784937986.163702:0:5799:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1784937986.163707:0:5799:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1784937986.163719:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1784937986.163722:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1784937986.163750:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784937986.163752:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784937986.164203:0:5823:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1784937986.164633:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1784937986.164675:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1784937986.164733:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1784937986.164745:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784937986.164747:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1784937986.165153:0:5824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1784937986.165485:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1784937986.165524:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1784937986.165557:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1784937986.165568:0:5799:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784937986.165570:0:5799:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1784937986.165575:0:5799:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1784937986.165578:0:5799:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1784937986.165584:0:5799:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1784937986.165591:0:5799:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1784937986.165922:0:5825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1784937986.166035:0:5799:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1784937986.175643:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1784937986.175696:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1784937986.175791:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1784937986.175814:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784937986.175836:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175856:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175865:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175871:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175876:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175883:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175888:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002adcaaee already unused, calling callback (000000007c4d99ed) 00010000:00010000:3.0:1784937986.175892:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175899:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175912:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175918:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.175923:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002adcaaee/0xea86628a8aec33f0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784937986.175950:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784937986.401929:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fefb75b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5786:x1871643065450752:12345-0@lo:253: Request processed in 244079us (244286us total) trans 0 rc 0/0 00000100:00100000:1.0:1784937986.401951:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784937986.402767:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000109221f7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065450752:0@lo:253: 10000000:01000000:3.0:1784937986.402787:0:5786:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784937986.402790:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784937986.402792:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784937986.402793:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784937986.402794:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1784937986.402795:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784937986.402796:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784937986.402798:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784937986.402799:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784937986.402800:0:5786:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1784937986.402801:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784937986.402802:0:5786:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1784937986.402901:0:5786:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004a825f35 from lustre-MDT0000 10000000:01000000:2.0:1784937986.402929:0:5786:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1784937986.402931:0:5786:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1784937986.402936:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa05ae17299c0 10000000:01000000:2.0:1784937986.402940:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784937986.402949:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa05ae17299c0 from 1 10000000:01000000:2.0:1784937986.402953:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1784937986.403021:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.403031:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.403114:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937986.403147:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000554015d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065450880:0@lo:101: 00000100:00100000:2.0:1784937986.403286:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937986.403402:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000aa8e9fd0 going to sleep for 11 seconds 00000100:00100000:3.0:1784937986.403779:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065450880 00000100:00100000:3.0:1784937986.403788:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065450880 00000100:00100000:3.0:1784937986.403872:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784937986.403881:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cb3b9ded pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5786:x1871643065450880:12345-0@lo:101: 00010000:00010000:3.0:1784937986.403895:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784937986.403910:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002adcaaee/0xea86628a8aec33fe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec33f7 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.403933:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002adcaaee/0xea86628a8aec33fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.403943:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002adcaaee/0xea86628a8aec33fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937986.403951:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002adcaaee, rc 0) 00000100:00100000:3.0:1784937986.403999:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cb3b9ded pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+6:5786:x1871643065450880:12345-0@lo:101: Request processed in 119us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1784937986.404015:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784937986.404103:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000554015d3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065450880:0@lo:101: 00010000:00010000:0.0:1784937986.404118:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.404127:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937986.404201:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451008:0@lo:501: 00000100:00100000:0.0:1784937986.404265:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784937986.404818:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d79ba00 going to sleep for 11 seconds 00000100:00100000:2.0:1784937986.404856:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451008 00000100:00100000:2.0:1784937986.404862:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451008 00000100:00100000:2.0:1784937986.404890:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784937986.404896:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3b39524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+6:5786:x1871643065451008:12345-0@lo:501: 00000100:00100000:2.0:1784937986.405306:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3b39524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+6:5786:x1871643065451008:12345-0@lo:501: Request processed in 408us (1040us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784937986.405316:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784937986.405510:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451008:0@lo:501: 10000000:01000000:0.0:1784937986.405541:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784937986.405562:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.405570:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 0000000021d572cb/0xea86628a8aec33f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784937986.405579:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa05ac735f800 10000000:01000000:0.0:1784937986.405584:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784937986.405588:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa05ac735f800 10000000:01000000:0.0:1784937986.405591:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1784937986.405594:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa05ac735f800 from 1 10000000:01000000:0.0:1784937986.405596:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1784937986.405625:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.405632:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.405651:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937986.405665:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451136:0@lo:101: 00000100:00100000:0.0:1784937986.405778:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937986.405802:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d79ba00 going to sleep for 11 seconds 00000100:00100000:2.0:1784937986.405867:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451136 00000100:00100000:2.0:1784937986.405873:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451136 00000100:00100000:2.0:1784937986.405899:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784937986.405905:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e816f500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+6:5786:x1871643065451136:12345-0@lo:101: 00010000:00010000:2.0:1784937986.405916:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784937986.405930:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ee276a8d/0xea86628a8aec340c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3405 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.405948:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ee276a8d/0xea86628a8aec340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3405 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.405956:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ee276a8d/0xea86628a8aec340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3405 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.405965:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ee276a8d, rc 0) 00000100:00100000:2.0:1784937986.406001:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e816f500 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+7:5786:x1871643065451136:12345-0@lo:101: Request processed in 97us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937986.406017:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784937986.406159:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451136:0@lo:101: 00010000:00010000:0.0:1784937986.406265:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.406272:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784937986.406283:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1784937986.406287:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.406293:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000c56de861/0xea86628a8aec3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784937986.406299:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1784937986.406302:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784937986.406307:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa05ac735f800 10000000:01000000:0.0:1784937986.406310:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1784937986.406313:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1784937986.406315:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784937986.406328:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.406340:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.406346:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937986.406359:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451264:0@lo:101: 00000100:00100000:0.0:1784937986.406568:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937986.406596:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d79ba00 going to sleep for 11 seconds 00000100:00100000:2.0:1784937986.406703:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451264 00000100:00100000:2.0:1784937986.406710:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451264 00000100:00100000:2.0:1784937986.406734:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784937986.406740:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004678fb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+7:5786:x1871643065451264:12345-0@lo:101: 00010000:00010000:2.0:1784937986.406752:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784937986.406760:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001835d339/0xea86628a8aec341a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3413 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.406774:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001835d339/0xea86628a8aec341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3413 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.406783:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001835d339/0xea86628a8aec341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3413 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937986.406789:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001835d339, rc 0) 00000100:00100000:2.0:1784937986.406825:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004678fb5f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+8:5786:x1871643065451264:12345-0@lo:101: Request processed in 85us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937986.406832:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784937986.407025:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451264:0@lo:101: 00010000:00010000:0.0:1784937986.407037:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937986.407057:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937986.407140:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451392:0@lo:501: 00000100:00100000:0.0:1784937986.407177:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937986.407194:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d79ba00 going to sleep for 11 seconds 00000100:00100000:2.0:1784937986.407371:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451392 00000100:00100000:2.0:1784937986.407385:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451392 00000100:00100000:2.0:1784937986.407416:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784937986.407587:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071940755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+8:5786:x1871643065451392:12345-0@lo:501: 00000100:00100000:2.0:1784937986.407994:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071940755 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5786:x1871643065451392:12345-0@lo:501: Request processed in 572us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937986.408002:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1784937986.408172:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451392:0@lo:501: 00000100:00100000:0.0:1784937986.408206:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451520:0@lo:503: 00000100:00100000:0.0:1784937986.408274:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937986.408543:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000004d79ba00 going to sleep for 11 seconds 00000100:00100000:1.0:1784937986.408640:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451520 00000100:00100000:1.0:1784937986.408646:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451520 00000100:00100000:3.0:1784937986.408704:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784937986.408824:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000124fc69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5786:x1871643065451520:12345-0@lo:503: 00000100:00100000:2.0:1784937986.409017:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000124fc69c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5786:x1871643065451520:12345-0@lo:503: Request processed in 305us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937986.409026:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784937986.409205:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451520:0@lo:503: 00000100:00100000:2.0:1784937986.410527:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e5cc4f78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5829:1871643065451648:0@lo:502: 00000100:00100000:2.0:1784937986.410606:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937986.410649:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set 0000000046968b66 going to sleep for 11 seconds 00000100:00100000:3.0:1784937986.410862:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451648 00000100:00100000:3.0:1784937986.410869:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451648 00000100:00100000:3.0:1784937986.410919:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784937986.410927:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b462beba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5829:x1871643065451648:12345-0@lo:502: 00000100:00100000:3.0:1784937986.411438:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b462beba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5829:x1871643065451648:12345-0@lo:502: Request processed in 510us (831us total) trans 0 rc 0/0 00000100:00100000:3.0:1784937986.411447:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784937986.411750:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e5cc4f78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5829:1871643065451648:0@lo:502: 00000020:01000000:0.0:1784937986.411792:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784937986.411805:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784937986.411808:0:5829:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784937986.411813:0:5829:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784937986.411816:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784937986.411841:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000003a0f4e42) 00000020:00000080:0.0:1784937986.411863:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784937986.411869:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784937986.411975:0:5829:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784937986.411982:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec3428 00000020:00000080:0.0:1784937986.412269:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784937986.412274:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784937986.412278:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784937986.412279:0:5829:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784937986.412282:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784937986.412286:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784937986.412287:0:5829:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784937986.412291:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784937986.412297:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000f8116f40) 00000020:00000080:0.0:1784937986.412307:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784937986.412310:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784937986.412312:0:5829:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784937986.412315:0:5829:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784937986.412321:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784937986.412361:0:5829:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004a825f35 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784937986.412383:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f1b7cb54) 00000020:00000080:0.0:1784937986.412391:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784937986.412453:0:5829:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784937986.412458:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec343d 00000020:00000080:0.0:1784937986.412556:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784937986.412563:0:5829:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784937986.412568:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xea86628a8aec3444 00080000:01000000:0.0:1784937986.412573:0:5829:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784937986.412582:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec344b 00080000:10000000:0.0:1784937986.413034:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1784937986.413307:0:5829:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1784937986.419006:0:5829:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:1.0:1784937986.532926:0:5829:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:1.0:1784937986.533991:0:5829:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:1.0:1784937986.543584:0:5829:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:1.0:1784937986.545930:0:5829:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1784937986.611983:0:5829:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001b55a766) 00000020:00000080:0.0:1784937986.612008:0:5829:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1784937986.612134:0:5829:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:0.0:1784937986.612143:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec3459 00000020:00000080:2.0:1784937986.625409:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1784937986.626743:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784937986.704555:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937986.756938:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1784937986.833740:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937986.918670:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:1.0:1784937986.930515:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1784937987.006980:0:5829:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1784937987.048907:0:5829:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xea86628a8aec3460 00000020:00000080:3.0:1784937987.049375:0:5829:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1784937987.049389:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784937987.049396:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784937987.049399:0:5829:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1784937987.049402:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784937987.049406:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784937987.049407:0:5829:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784937987.049410:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784937987.049411:0:5829:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1784937987.049414:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784937987.049416:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784937987.049417:0:5829:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1784937987.049420:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784937987.049424:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784937987.049425:0:5829:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1784937987.049429:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1784937987.049470:0:5829:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1784937987.049541:0:5829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000109221f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5829:1871643065451776:0@lo:502: 00000100:00100000:3.0:1784937987.049627:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937987.049693:0:5829:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b37d6c6c going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.049796:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451776 00000100:00100000:2.0:1784937987.049805:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451776 00000100:00100000:2.0:1784937987.049856:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784937987.049863:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b973a044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5829:x1871643065451776:12345-0@lo:502: 00000100:00100000:3.0:1784937987.050549:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b973a044 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5829:x1871643065451776:12345-0@lo:502: Request processed in 684us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1784937987.050559:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784937987.050644:0:5829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000109221f7 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5829:1871643065451776:0@lo:502: 00000020:01000000:2.0:1784937987.050676:0:5829:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784937987.050682:0:5829:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784937987.050684:0:5829:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1784937987.050688:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1784937987.050871:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1784937987.050894:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784937987.050939:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937987.050952:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000931a6907/0xea86628a8aec3413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784937987.050961:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05ac735f800 from 1 10000000:01000000:0.0:1784937987.050964:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784937987.050998:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937987.051005:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937987.051015:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937987.051030:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451904:0@lo:101: 00000100:00100000:0.0:1784937987.051069:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937987.051112:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ea55fb4 going to sleep for 11 seconds 00000100:00100000:1.0:1784937987.051182:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065451904 00000100:00100000:1.0:1784937987.051188:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065451904 00000100:00100000:1.0:1784937987.051245:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784937987.051253:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7d2a180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:5786:x1871643065451904:12345-0@lo:101: 00010000:00010000:1.0:1784937987.051267:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784937987.051283:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3467 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784937987.051305:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3467 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784937987.051330:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3467 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784937987.051340:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ff0221b6, rc 0) 00000100:00100000:1.0:1784937987.051391:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7d2a180 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:5786:x1871643065451904:12345-0@lo:101: Request processed in 139us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784937987.051398:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1784937987.051559:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065451904:0@lo:101: 00010000:00010000:0.0:1784937987.051579:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937987.051588:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937987.052139:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452032:0@lo:256: 00000100:00100000:0.0:1784937987.052193:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937987.052300:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000001ea55fb4 going to sleep for 11 seconds 00000100:00100000:3.0:1784937987.052523:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452032 00000100:00100000:3.0:1784937987.052530:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452032 00000100:00100000:3.0:1784937987.052571:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1784937987.052578:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000031bbc02a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:5786:x1871643065452032:12345-0@lo:256: 20000000:01000000:3.0:1784937987.052598:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1784937987.052604:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1784937987.052688:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000031bbc02a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:5786:x1871643065452032:12345-0@lo:256: Request processed in 111us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1784937987.052695:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784937987.052768:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007d6a760f pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452032:0@lo:256: 10000000:01000000:2.0:1784937987.053380:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784937987.053403:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053412:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784937987.053429:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac735f800 from 1 10000000:01000000:2.0:1784937987.053432:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784937987.053463:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053470:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053478:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937987.053493:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452160:0@lo:101: 00000100:00100000:2.0:1784937987.053530:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.053560:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2dd8460 going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.053582:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452160 00000100:00100000:2.0:1784937987.053588:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452160 00000100:00100000:2.0:1784937987.053616:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784937987.053623:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004e8eaff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:5786:x1871643065452160:12345-0@lo:101: 00010000:00010000:2.0:1784937987.053633:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784937987.053646:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3475 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053663:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3475 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053673:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3475 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053680:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000087fb4423, rc 0) 00000100:00100000:2.0:1784937987.053717:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004e8eaff3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065452160:12345-0@lo:101: Request processed in 94us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.053723:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784937987.053761:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452160:0@lo:101: 00010000:00010000:2.0:1784937987.053773:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.053781:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937987.053827:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452288:0@lo:501: 00000100:00100000:2.0:1784937987.053850:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.053862:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2dd8460 going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.053874:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452288 00000100:00100000:2.0:1784937987.053877:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452288 00000100:00100000:2.0:1784937987.053897:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784937987.053903:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c522793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065452288:12345-0@lo:501: 00000100:00100000:2.0:1784937987.054420:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c522793 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065452288:12345-0@lo:501: Request processed in 516us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.054427:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784937987.054496:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452288:0@lo:501: 00000100:00100000:2.0:1784937987.054524:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452416:0@lo:503: 00000100:00100000:2.0:1784937987.054561:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.054581:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c2dd8460 going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.054595:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452416 00000100:00100000:2.0:1784937987.054598:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452416 00000100:00100000:2.0:1784937987.054621:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784937987.054632:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002f060cb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065452416:12345-0@lo:503: 00000040:00080000:2.0:1784937987.054665:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784937987.054702:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002f060cb1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065452416:12345-0@lo:503: Request processed in 69us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.054708:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784937987.054744:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452416:0@lo:503: 00000040:00080000:2.0:1784937987.055472:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1784937987.055516:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1784937987.055530:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784937987.055538:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055548:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784937987.055582:0:5786:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784937987.055585:0:5786:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa05ac735f800 10000000:01000000:2.0:1784937987.055588:0:5786:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa05ac735f800 10000000:01000000:2.0:1784937987.055592:0:5786:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784937987.055598:0:5786:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac735f800 from 1 10000000:01000000:2.0:1784937987.055600:0:5786:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784937987.055624:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055631:0:5786:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055641:0:5786:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937987.055666:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452544:0@lo:101: 00000100:00100000:2.0:1784937987.055699:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.055721:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d7e61ced going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.055737:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452544 00000100:00100000:2.0:1784937987.055742:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452544 00000100:00100000:2.0:1784937987.055766:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784937987.055771:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ea34048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065452544:12345-0@lo:101: 00010000:00010000:2.0:1784937987.055783:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784937987.055804:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000046f02b5e/0xea86628a8aec348a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3483 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055823:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000046f02b5e/0xea86628a8aec348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3483 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055831:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000046f02b5e/0xea86628a8aec348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3483 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055840:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000046f02b5e, rc 0) 00000100:00100000:2.0:1784937987.055868:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ea34048 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5786:x1871643065452544:12345-0@lo:101: Request processed in 97us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.055875:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784937987.055912:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452544:0@lo:101: 00010000:00010000:2.0:1784937987.055923:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.055932:0:5786:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937987.055979:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452672:0@lo:501: 00000100:00100000:2.0:1784937987.056001:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.056012:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d7e61ced going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.056023:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452672 00000100:00100000:2.0:1784937987.056026:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452672 00000100:00100000:2.0:1784937987.056044:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784937987.056049:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aaec0c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5786:x1871643065452672:12345-0@lo:501: 00000100:00100000:2.0:1784937987.058667:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aaec0c9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5786:x1871643065452672:12345-0@lo:501: Request processed in 2610us (2657us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.058683:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784937987.058800:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ab79a095 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452672:0@lo:501: 00000100:00100000:3.0:1784937987.058853:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc71c05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452800:0@lo:503: 00000100:00100000:3.0:1784937987.058901:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937987.058944:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 000000005fda93cf going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.058993:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452800 00000100:00100000:2.0:1784937987.059001:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452800 00000100:00100000:2.0:1784937987.059045:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784937987.059053:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f044fc7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5786:x1871643065452800:12345-0@lo:503: 00000100:00100000:2.0:1784937987.059564:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f044fc7f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5786:x1871643065452800:12345-0@lo:503: Request processed in 510us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.059572:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784937987.059719:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc71c05 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065452800:0@lo:503: 00000100:00100000:3.0:1784937987.060034:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000bfc71c05 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5834:1871643065452928:0@lo:502: 00000100:00100000:3.0:1784937987.060089:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937987.060120:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set 00000000eff4f4c7 going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.060255:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065452928 00000100:00100000:2.0:1784937987.060261:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065452928 00000100:00100000:2.0:1784937987.060292:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784937987.060299:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000091f907b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5834:x1871643065452928:12345-0@lo:502: 00000100:00100000:2.0:1784937987.060523:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000091f907b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5834:x1871643065452928:12345-0@lo:502: Request processed in 224us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.060530:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784937987.060616:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000bfc71c05 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5834:1871643065452928:0@lo:502: 00000020:01000004:0.0:1784937987.060674:0:5834:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1784937987.060703:0:5834:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b4f190ed) 00000020:00000080:0.0:1784937987.060725:0:5834:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1784937987.060906:0:5834:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004a825f35 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784937987.060911:0:5834:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004a825f35 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1784937987.060915:0:5834:0:(obd_mount.c:706:lustre_put_lsi()) put 000000004a825f35 4 00010000:00080000:0.0:1784937987.060950:0:5834:0:(ldlm_lib.c:125:import_set_conn()) imp 00000000f2bae1b3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1784937987.063926:0:5834:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1784937987.064050:0:5834:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1784937987.064104:0:5834:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784937987.064118:0:5834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xea86628a8aec3498 00000100:00080000:0.0:1784937987.064132:0:5834:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:0.0:1784937987.064143:0:5834:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f2bae1b3 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:0.0:1784937987.067334:0:5834:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000aace8afd x1871643065453056/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784937987.067428:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000aace8afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065453056:192.168.201.158@tcp:38: 00000100:00100000:2.0:1784937987.067796:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784937987.067856:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453056 00000100:00100000:2.0:1784937987.067865:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453056 00000100:00100000:2.0:1784937987.067910:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784937987.067918:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a7604e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3320:x1871643065453056:12345-192.168.201.158@tcp:38: 00000100:00100000:2.0:1784937987.067980:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a7604e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3320:x1871643065453056:12345-192.168.201.158@tcp:38: Request processed in 61us (185us total) trans 0 rc -11/-11 00000100:00100000:2.0:1784937987.067987:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00080000:0.0:1784937987.071136:0:5834:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1784937987.072653:0:5834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ba5f5f78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5834:1871643065453184:0@lo:502: 00000100:00100000:0.0:1784937987.072760:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937987.072803:0:5834:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf8986ea going to sleep for 11 seconds 00000100:00100000:1.0:1784937987.072884:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784937987.072893:0:3320:0:(import.c:65:import_set_state_nolock()) 00000000f2bae1b3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784937987.072900:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.158@tcp failed (-11) 00000100:00100000:1.0:1784937987.072903:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000aace8afd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065453056:192.168.201.158@tcp:38: 00000100:00100000:2.0:1784937987.072977:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453184 00000100:00100000:2.0:1784937987.072984:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453184 00000100:00100000:2.0:1784937987.073036:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784937987.073045:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4b0dab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5834:x1871643065453184:12345-0@lo:502: 00000100:00100000:2.0:1784937987.073452:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4b0dab9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5834:x1871643065453184:12345-0@lo:502: Request processed in 408us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.073461:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784937987.073551:0:5834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ba5f5f78 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5834:1871643065453184:0@lo:502: 00000040:00080000:0.0:1784937987.073577:0:5834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:2.0:1784937987.073740:0:5786:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1784937987.073759:0:5786:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784937987.073782:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.073793:0:5786:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000f7c3e8b7/0xea86628a8aec3483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784937987.073833:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784937987.073836:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784937987.073838:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784937987.073839:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784937987.073840:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784937987.073842:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784937987.073844:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784937987.073846:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784937987.073847:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784937987.073852:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784937987.073853:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784937987.073855:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784937987.073858:0:5786:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1784937987.073861:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784937987.073862:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784937987.073863:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784937987.073864:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784937987.073865:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784937987.073866:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784937987.073867:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784937987.073868:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784937987.073869:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784937987.073870:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784937987.073871:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784937987.073872:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784937987.073890:0:5786:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1784937987.073900:0:5786:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002a327793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065453312:0@lo:253: 00000100:00100000:2.0:1784937987.073936:0:5786:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.074040:0:5786:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ff779a64 going to sleep for 11 seconds 00000100:00100000:1.0:1784937987.074417:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453312 00000100:00100000:1.0:1784937987.074426:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453312 00000100:00100000:2.0:1784937987.074522:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784937987.074531:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004379e15a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5786:x1871643065453312:12345-0@lo:253: 20000000:01000000:2.0:1784937987.074578:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784937987.074592:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1784937987.099454:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1784937987.099477:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784937987.099541:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784937987.099547:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784937987.099572:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.099606:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3467 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.099616:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.099663:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3467 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.099680:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3467 expref: 12 pid: 5799 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784937987.099698:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1871643065453440:0@lo:104: 00000100:00100000:3.0:1784937987.099779:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937987.099840:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set 0000000005b566fe going to sleep for 11 seconds 00000100:00100000:2.0:1784937987.099907:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453440 00000100:00100000:2.0:1784937987.099916:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453440 00000100:00100000:2.0:1784937987.099975:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784937987.099984:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f3ebd24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5820:x1871643065453440:12345-0@lo:104: 00010000:00010000:2.0:1784937987.099998:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100051:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784937987.100063:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f3ebd24 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5820:x1871643065453440:12345-0@lo:104: Request processed in 81us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.100080:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784937987.100103:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784937987.100109:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100117:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b484cde0 already unused, calling callback (000000008833df76) 10000000:00010000:2.0:1784937987.100120:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100128:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784937987.100135:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784937987.100141:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784937987.100256:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100264:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784937987.100283:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100289:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: 00000000b484cde0/0xea86628a8aec3467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec346e expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100309:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937987.100311:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937987.100312:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784937987.100418:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784937987.100428:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007b65c8a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065453568:0@lo:103: 00000100:00100000:2.0:1784937987.100459:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937987.100493:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453568 00000100:00100000:2.0:1784937987.100497:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453568 00010000:00010000:2.0:1784937987.100515:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3467 expref: 13 pid: 5799 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937987.100538:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784937987.100545:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c7e6059 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065453568:12345-0@lo:103: 00010000:00010000:2.0:1784937987.100555:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784937987.100559:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3467 expref: 13 pid: 5799 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100570:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3467 expref: 13 pid: 5799 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100584:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100592:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784937987.100604:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001058178s 00010000:00010000:2.0:1784937987.100608:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100614:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100621:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100632:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100638:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002e88828b already unused, calling callback (000000007c4d99ed) 00010000:00010000:2.0:1784937987.100641:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100647:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100656:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784937987.100666:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784937987.100692:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c7e6059 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065453568:12345-0@lo:103: Request processed in 149us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.100700:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784937987.100737:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007b65c8a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065453568:0@lo:103: 00010000:00010000:3.0:1784937987.100892:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ff0221b6/0xea86628a8aec346e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3467 expref: 12 pid: 5799 timeout: 346 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784937987.100905:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1871643065453440:0@lo:104: 00010000:00010000:3.0:1784937987.100918:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.100927:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.100932:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937987.100939:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002e88828b/0xea86628a8aec349f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784937987.118883:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004379e15a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5786:x1871643065453312:12345-0@lo:253: Request processed in 44345us (44938us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937987.118901:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784937987.119013:0:5786:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002a327793 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5786:1871643065453312:0@lo:253: 10000000:01000000:3.0:1784937987.119029:0:5786:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784937987.119033:0:5786:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784937987.119035:0:5786:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784937987.119037:0:5786:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784937987.119038:0:5786:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784937987.119040:0:5786:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784937987.119041:0:5786:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784937987.119043:0:5786:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784937987.119044:0:5786:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784937987.119046:0:5786:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1784937987.119048:0:5786:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1784937987.119050:0:5786:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784937987.119051:0:5786:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1784937987.119092:0:5786:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784937987.125838:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937987.127559:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784937987.127837:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937987.128001:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784937987.129144:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937987.129549:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1784937987.130292:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937987.130487:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1784937987.130713:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937987.130884:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1784937987.131103:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1784937987.131372:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1784937987.248307:0:5786:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1784937987.278511:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1784937987.278982:0:5840:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1784937987.282710:0:5839:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1784937987.282719:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1784937987.285185:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1784937987.285412:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1784937987.285871:0:5786:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1784937987.285879:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1784937987.286008:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784937987.290771:0:5786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1784937987.293950:0:5786:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1784937987.294021:0:5786:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1784937987.295407:0:5786:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1784937987.295604:0:5786:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1784937987.299289:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1784937987.299454:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1784937987.299598:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1784937987.299775:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1784937987.300300:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1784937987.300464:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1784937987.300606:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1784937987.302571:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1784937987.302996:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1784937987.303449:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1784937987.303608:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1784937987.303767:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1784937987.304299:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1784937987.304463:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1784937987.304616:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1784937987.304782:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1784937987.305511:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1784937987.305688:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1784937987.305841:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1784937987.306002:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1784937987.306447:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1784937987.306607:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1784937987.306769:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1784937987.307401:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1784937987.307539:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1784937987.307693:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1784937987.308018:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1784937987.308386:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1784937987.308540:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1784937987.308687:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1784937987.308915:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1784937987.309105:0:5786:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1784937987.309610:0:5786:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:0.0:1784937987.339256:0:5840:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1784937987.406468:0:5786:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1784937987.406509:0:5786:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7b301b6b988 00100000:10000000:1.0:1784937987.406519:0:5786:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1784937987.411256:0:5786:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784937987.411277:0:5786:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784937987.411295:0:5786:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1784937987.411313:0:5786:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1784937987.466414:0:5840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1784937987.466505:0:5840:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1784937987.466510:0:5840:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1784937987.953481:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784937988.977336:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937990.001369:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937991.031466:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937992.053683:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784937992.250627:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1784937992.250638:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1784937992.250641:0:8:0:(import.c:65:import_set_state_nolock()) 00000000f2bae1b3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784937992.250656:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000f2bae1b3 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784937992.250679:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000346b2fc x1871643065453824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784937992.250759:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784937992.250776:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007fca5049 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065453696:0@lo:400: 00000100:00100000:1.0:1784937992.250842:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784937992.250898:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000346b2fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065453824:192.168.201.158@tcp:38: 00000100:00100000:1.0:1784937992.250973:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453696 00000100:00100000:1.0:1784937992.250992:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453696 00000100:00100000:1.0:1784937992.251039:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784937992.251047:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000089900e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:3324:x1871643065453696:12345-0@lo:400: 00000100:00100000:1.0:1784937992.251113:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000089900e3f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:3324:x1871643065453696:12345-0@lo:400: Request processed in 67us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1784937992.251122:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784937992.258076:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784937992.258094:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007fca5049 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065453696:0@lo:400: 00000100:00100000:2.0:1784937992.260764:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453824 00000100:00100000:2.0:1784937992.260782:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453824 00000100:00100000:2.0:1784937992.260848:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784937992.260855:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000c60b8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1871643065453824:12345-192.168.201.158@tcp:38: 00010000:00080000:2.0:1784937992.260887:0:5806:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:2.0:1784937992.260946:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xea86628a8aec34a6 00000004:00100000:2.0:1784937992.260999:0:5806:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784937992.261159:0:5806:0:(import.c:65:import_set_state_nolock()) 000000006476994d : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784937992.261256:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000c60b8ca pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871643065453824:12345-192.168.201.158@tcp:38: Request processed in 399us (3191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937992.261265:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:0.0:1784937992.262426:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000346b2fc x1871643065453824/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938002 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784937992.262448:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784937992.262456:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1784937992.262461:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784937992.262463:0:3320:0:(import.c:65:import_set_state_nolock()) 00000000f2bae1b3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1784937992.262470:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000346b2fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065453824:192.168.201.158@tcp:38: 00000001:02000400:3.0:1784937992.580899:0:6083:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:0.0:1784937992.754325:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784937992.754333:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05ac735f800 from 3 10000000:01000000:0.0:1784937992.754338:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784937992.754381:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937992.754393:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937992.754415:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937992.754438:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ba5f5f78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065453952:0@lo:101: 00000100:00100000:0.0:1784937992.754512:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937992.754558:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000002d420ffa going to sleep for 11 seconds 00000100:00100000:0.0:1784937992.754584:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065453952 00000100:00100000:0.0:1784937992.754591:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065453952 00000100:00100000:0.0:1784937992.754637:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784937992.754655:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd3c86eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5802:x1871643065453952:12345-0@lo:101: 00010000:00010000:0.0:1784937992.754670:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784937992.754683:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b484cde0/0xea86628a8aec34b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec34ad expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937992.754705:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b484cde0/0xea86628a8aec34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec34ad expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937992.754714:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b484cde0/0xea86628a8aec34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec34ad expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937992.754724:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b484cde0, rc 0) 00000100:00100000:0.0:1784937992.754762:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd3c86eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065453952:12345-0@lo:101: Request processed in 117us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1784937992.754768:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784937992.773904:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ba5f5f78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065453952:0@lo:101: 00010000:00010000:0.0:1784937992.773936:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937992.773960:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937992.774046:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ba5f5f78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065454080:0@lo:256: 00000100:00100000:0.0:1784937992.774561:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784937992.774606:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000002d420ffa going to sleep for 11 seconds 00000100:00100000:3.0:1784937992.775206:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454080 00000100:00100000:3.0:1784937992.775487:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454080 00000100:00100000:3.0:1784937992.775536:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784937992.775544:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000058508690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065454080:12345-0@lo:256: 20000000:01000000:3.0:1784937992.775565:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784937992.775581:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784937992.775583:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1784937992.777233:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000058508690 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065454080:12345-0@lo:256: Request processed in 1684us (2667us total) trans 0 rc 0/0 00000100:00100000:3.0:1784937992.777246:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1784937992.777340:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ba5f5f78 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065454080:0@lo:256: 10000000:01000000:3.0:1784937992.777407:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784937992.777415:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937992.777425:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000af9dc72d/0xea86628a8aec34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937993.074048:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937994.097607:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937995.121506:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937996.153582:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937997.170344:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784937997.361444:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f5c2b2f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065454208:0@lo:400: 00000100:00100000:2.0:1784937997.361530:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784937997.361602:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000000e3952b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065454336:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784937997.361742:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454208 00000100:00100000:1.0:1784937997.361752:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454208 00000100:00100000:1.0:1784937997.361813:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784937997.361823:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7c454eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:3324:x1871643065454208:12345-0@lo:400: 00000100:00100000:1.0:1784937997.361889:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7c454eb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:3324:x1871643065454208:12345-0@lo:400: Request processed in 68us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1784937997.361907:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1784937997.362095:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784937997.362182:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454336 00000100:00100000:2.0:1784937997.362186:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454336 00000100:00100000:2.0:1784937997.362237:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784937997.362241:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1042e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065454336:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784937997.362285:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1042e37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065454336:12345-192.168.201.158@tcp:400: Request processed in 44us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1784937997.362290:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00010000:00080000:2.0:1784937997.362413:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000e3952b1 x1871643065454336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938013 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784937997.362427:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000000e3952b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065454336:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784937997.362447:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f5c2b2f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065454208:0@lo:400: 00000020:00000080:3.0:1784937997.857587:0:6285:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd8b239400 20000000:00000080:3.0:1784937997.857734:0:6285:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa05afc8ae000 uarg=0000000000000000 20000000:01000000:3.0:1784937997.857785:0:6285:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1784937997.857794:0:6285:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1784937997.857800:0:6285:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1784937997.864804:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1784937997.864828:0:6285:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1784937997.870340:0:6285:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784937997.870771:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1784937997.870839:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1784937997.870903:0:6285:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1784937997.870924:0:6285:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784937997.870949:0:6285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937997.870974:0:6285:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3475 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937997.870983:0:6285:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937997.871407:0:6285:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3475 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937997.871437:0:6285:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3475 expref: 11 pid: 5798 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784937997.871453:0:6285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6285:1871643065454464:0@lo:104: 00000100:00100000:3.0:1784937997.871704:0:6285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937997.871805:0:6285:0:(client.c:2702:ptlrpc_set_wait()) set 000000003aa42953 going to sleep for 11 seconds 00000100:00100000:0.0:1784937997.879751:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454464 00000100:00100000:0.0:1784937997.879765:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454464 00000100:00100000:0.0:1784937997.879844:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784937997.879853:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020505430 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:6285:x1871643065454464:12345-0@lo:104: 00010000:00010000:0.0:1784937997.879874:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.879991:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784937997.879997:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020505430 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:6285:x1871643065454464:12345-0@lo:104: Request processed in 146us (8295us total) trans 0 rc 0/0 00000100:00100000:0.0:1784937997.880004:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1784937997.880028:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784937997.880034:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.880042:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fca9ea70 already unused, calling callback (000000008833df76) 10000000:00010000:0.0:1784937997.880046:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.880070:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784937997.880077:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784937997.880083:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784937997.880127:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.880134:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784937997.880155:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.880161:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: 00000000fca9ea70/0xea86628a8aec3475 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec347c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.880180:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937997.880181:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784937997.880182:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784937997.880208:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c08e689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065454592:0@lo:103: 00000100:00100000:0.0:1784937997.880270:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784937997.880489:0:6285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6285:1871643065454464:0@lo:104: 00010000:00010000:3.0:1784937997.880523:0:6285:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937997.880865:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454592 00000100:00100000:0.0:1784937997.880879:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454592 00010000:00010000:0.0:1784937997.880939:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3475 expref: 12 pid: 5798 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784937997.880994:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784937997.881004:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da3239ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:3322:x1871643065454592:12345-0@lo:103: 00010000:00010000:0.0:1784937997.881029:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784937997.881035:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3475 expref: 12 pid: 5798 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881055:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3475 expref: 12 pid: 5798 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881077:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000087fb4423/0xea86628a8aec347c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3475 expref: 12 pid: 5798 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881099:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881108:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881127:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881134:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881141:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881146:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881152:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000002e76e6b already unused, calling callback (000000007c4d99ed) 00010000:00010000:0.0:1784937997.881157:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881175:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881193:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937997.881280:0:6285:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784937997.881292:0:6285:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881554:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000002e76e6b/0xea86628a8aec34bb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784937997.881574:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784937997.881661:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da3239ab pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:3322:x1871643065454592:12345-0@lo:103: Request processed in 659us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1784937997.881670:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784937997.882025:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c08e689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065454592:0@lo:103: 00010000:00010000:0.0:1784937998.194364:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784937999.220533:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938000.242070:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938001.267485:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938002.306413:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938002.483283:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938002.483296:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac735f800 from 1 10000000:01000000:3.0:1784938002.483302:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938002.483345:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 0000000078d6fa93/0xea86628a8aec34c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938002.483370:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002c08e689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065454720:0@lo:400: 00010000:00010000:3.0:1784938002.483371:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 0000000078d6fa93/0xea86628a8aec34c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938002.483384:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 0000000078d6fa93/0xea86628a8aec34c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938002.483402:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065454848:0@lo:101: 00000100:00100000:0.0:1784938002.483472:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938002.483535:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454720 00000100:00100000:0.0:1784938002.483536:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938002.483545:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454720 00000100:00100000:0.0:1784938002.483546:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ea23d89c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065454976:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938002.483599:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938002.483608:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c4ca9098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:3323:x1871643065454720:12345-0@lo:400: 00000100:00100000:1.0:1784938002.483672:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c4ca9098 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:3323:x1871643065454720:12345-0@lo:400: Request processed in 65us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938002.483680:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938002.483740:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002c08e689 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065454720:0@lo:400: 00000100:00100000:0.0:1784938002.483804:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938002.483959:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938002.483991:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000002157b98b going to sleep for 11 seconds 00000100:00100000:1.0:1784938002.484075:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454976 00000100:00100000:1.0:1784938002.484079:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454976 00000100:00100000:1.0:1784938002.484110:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:1.0:1784938002.484116:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ea3fc9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065454976:12345-192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938002.484165:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ea3fc9f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065454976:12345-192.168.201.158@tcp:400: Request processed in 49us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938002.484171:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:1.0:1784938002.484338:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ea23d89c x1871643065454976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938002.484351:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ea23d89c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065454976:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938002.484756:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065454848 00000100:00100000:0.0:1784938002.484761:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065454848 00000100:00100000:0.0:1784938002.484788:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938002.484796:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eb24310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:5802:x1871643065454848:12345-0@lo:101: 00010000:00010000:0.0:1784938002.484818:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938002.484846:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000640c2255/0xea86628a8aec34c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec34c2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938002.484900:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000640c2255/0xea86628a8aec34c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938002.484915:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000640c2255/0xea86628a8aec34c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938002.484926:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000640c2255, rc 0) 00000100:00100000:1.0:1784938002.485016:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eb24310 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065454848:12345-0@lo:101: Request processed in 208us (1042us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938002.485023:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938002.485187:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065454848:0@lo:101: 00010000:00010000:3.0:1784938002.485203:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 0000000078d6fa93/0xea86628a8aec34c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938002.485770:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 0000000078d6fa93/0xea86628a8aec34c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938002.485879:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065455104:0@lo:501: 00000100:00100000:3.0:1784938002.485931:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938002.486315:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 000000002157b98b going to sleep for 11 seconds 00000100:00100000:1.0:1784938002.486618:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455104 00000100:00100000:1.0:1784938002.486627:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455104 00000100:00100000:1.0:1784938002.486713:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1784938002.486722:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000029e849bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065455104:12345-0@lo:501: 00000100:00100000:1.0:1784938002.487106:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000029e849bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065455104:12345-0@lo:501: Request processed in 385us (1175us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938002.487116:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938002.487246:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000224f02b5 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065455104:0@lo:501: 00000100:00100000:0.0:1784938002.487313:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000041cad9f7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065455232:0@lo:503: 00000100:00100000:0.0:1784938002.487361:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938002.487389:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab75cf55 going to sleep for 11 seconds 00000100:00100000:3.0:1784938002.487397:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455232 00000100:00100000:3.0:1784938002.487402:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455232 00000100:00100000:3.0:1784938002.487495:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938002.487504:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043cde90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065455232:12345-0@lo:503: 00000100:00100000:3.0:1784938002.487749:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043cde90d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065455232:12345-0@lo:503: Request processed in 247us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938002.487757:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784938002.487758:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000041cad9f7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065455232:0@lo:503: 00000100:00100000:3.0:1784938002.492086:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001396b1c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6537:1871643065455360:0@lo:502: 00000100:00100000:3.0:1784938002.492252:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938002.492315:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set 000000005adc0403 going to sleep for 11 seconds 00000100:00100000:0.0:1784938002.492411:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455360 00000100:00100000:0.0:1784938002.492430:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455360 00000100:00100000:0.0:1784938002.492573:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938002.492584:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004437ad48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6537:x1871643065455360:12345-0@lo:502: 00000100:00100000:0.0:1784938002.492932:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004437ad48 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6537:x1871643065455360:12345-0@lo:502: Request processed in 349us (680us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938002.492941:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1784938002.493802:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001396b1c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6537:1871643065455360:0@lo:502: 00000020:01000000:1.0:1784938002.493859:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938002.493873:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938002.493881:0:6537:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938002.493892:0:6537:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05ac735f800 00000020:00000080:1.0:1784938002.493895:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938002.493959:0:6537:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6537:1871643065455488:0@lo:502: 00000100:00100000:1.0:1784938002.494425:0:6537:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938002.494467:0:6537:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac684bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938002.494815:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455488 00000100:00100000:0.0:1784938002.494824:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455488 00000100:00100000:0.0:1784938002.494882:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1784938002.494892:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6537:x1871643065455488:12345-0@lo:502: 00000100:00100000:0.0:1784938002.495190:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6537:x1871643065455488:12345-0@lo:502: Request processed in 298us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938002.495198:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1784938002.495271:0:6537:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6537:1871643065455488:0@lo:502: 00000020:01000000:2.0:1784938002.495300:0:6537:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938002.495305:0:6537:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938002.495308:0:6537:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1784938002.495312:0:6537:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1784938002.495786:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1784938002.495821:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938002.495835:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938002.495847:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938003.314474:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784938003.849336:0:6601:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:1.0:1784938003.849342:0:6601:0:(obd_mount.c:922:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1784938003.849500:0:6601:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa05ac73fb000 00000020:01000004:1.0:1784938003.849522:0:6601:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1784938003.849537:0:6601:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1784938003.849555:0:6601:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa05ae1728000) 00000020:00000080:1.0:1784938003.849574:0:6601:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784938003.863813:0:6601:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1784938003.867188:0:6601:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1784938003.887993:0:6601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1784938003.894687:0:6601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1784938003.894729:0:6601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1784938003.894804:0:6601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1784938003.894848:0:6601:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1784938003.895413:0:6601:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784938003.895427:0:6601:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938003.895440:0:6601:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea86628a8aec34d7 00000020:01000004:2.0:1784938003.895450:0:6601:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784938003.895484:0:6601:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784938003.895488:0:6601:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784938003.895501:0:6601:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784938003.895507:0:6601:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784938003.895530:0:6601:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa05ad1a24d40) 00000020:00000080:2.0:1784938003.895545:0:6601:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1784938003.897269:0:6601:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938003.897485:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938003.897493:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1784938003.902487:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938003.902509:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:2.0:1784938003.903040:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938003.903049:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784938003.909016:0:6601:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938003.910167:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784938003.910178:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1784938003.915161:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1784938003.915180:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1784938003.936706:0:6601:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938003.937138:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938003.937146:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1784938003.939416:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1784938003.939436:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1784938003.941180:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1784938003.941200:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1784938003.944044:0:6601:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938003.944482:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1784938003.944490:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1784938003.945318:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1784938003.945329:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1784938003.986824:0:6601:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938003.987170:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1784938003.987180:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1784938003.993533:0:6601:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1784938003.993556:0:6601:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1784938003.996326:0:6601:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1784938003.996380:0:6601:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1784938003.996389:0:6601:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1784938004.017705:0:6601:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784938004.017758:0:6601:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1784938004.017764:0:6601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784938004.017766:0:6601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938004.017767:0:6601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938004.017768:0:6601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938004.017770:0:6601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938004.017771:0:6601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938004.017773:0:6601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938004.017775:0:6601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938004.017776:0:6601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938004.017789:0:6601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938004.017791:0:6601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938004.017796:0:6601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1784938004.017800:0:6601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938004.017801:0:6601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938004.017802:0:6601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938004.017804:0:6601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938004.017805:0:6601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938004.017806:0:6601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938004.017807:0:6601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938004.017808:0:6601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938004.017809:0:6601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938004.017810:0:6601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938004.017811:0:6601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938004.017849:0:6601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784938004.018164:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065455616:0@lo:253: 00000100:00100000:0.0:1784938004.018319:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938004.018431:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac88dc780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938004.018568:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455616 00000100:00100000:2.0:1784938004.018579:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455616 00000100:00100000:2.0:1784938004.018646:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1784938004.018658:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065455616:12345-0@lo:253: 20000000:01000000:2.0:1784938004.018709:0:5799:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1784938004.018714:0:5799:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1784938004.018720:0:5799:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1784938004.018724:0:5799:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1784938004.019712:0:5799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938004.019974:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1784938004.019991:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1784938004.020045:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1784938004.020054:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1784938004.020086:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1784938004.020135:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1784938004.020565:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1784938004.020587:0:5799:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:2.0:1784938004.020589:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:2.0:1784938004.020623:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1784938004.020631:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1784938004.020692:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1784938004.020700:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:2.0:1784938004.020734:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1784938004.020744:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784938004.020774:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1784938004.020842:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1784938004.021614:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1784938004.021633:0:5799:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:2.0:1784938004.021635:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:2.0:1784938004.021670:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1784938004.021678:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784938004.021712:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1784938004.021720:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:2.0:1784938004.021767:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1784938004.021777:0:5799:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1784938004.022686:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1784938004.022728:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1784938004.022749:0:5799:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1784938004.022753:0:5799:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1784938004.022761:0:5799:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784938004.022762:0:5799:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784938004.022764:0:5799:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784938004.022789:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784938004.022792:0:5799:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784938004.022841:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1784938004.022844:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784938004.023723:0:6615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1784938004.023813:0:6615:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1784938004.023887:0:6615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1784938004.024321:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1784938004.024365:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1784938004.024427:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1784938004.024441:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1784938004.024444:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784938004.025048:0:6616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1784938004.025102:0:6616:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1784938004.025152:0:6616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1784938004.025460:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1784938004.025502:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1784938004.025538:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1784938004.025549:0:5799:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1784938004.025552:0:5799:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1784938004.026003:0:6617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1784938004.026197:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1784938004.026281:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1784938004.026346:0:5799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1784938004.026367:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784938004.026394:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026416:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026424:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3413 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026442:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3483 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026450:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026500:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3483 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026520:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3483 expref: 12 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.026538:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5799:1871643065455744:0@lo:104: 00000100:00100000:2.0:1784938004.026641:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938004.026705:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3413 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026714:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3413 expref: 12 pid: 5797 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.026722:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5799:1871643065455872:0@lo:104: 00000100:00100000:2.0:1784938004.026742:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938004.026769:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.026777:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 12 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.026797:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5799:1871643065456000:0@lo:104: 00000100:00100000:2.0:1784938004.026824:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.026836:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938004.026986:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455744 00000100:00100000:1.0:1784938004.026996:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455744 00000100:00100000:1.0:1784938004.027040:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065455872 00000100:00100000:1.0:1784938004.027042:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065455872 00000100:00100000:1.0:1784938004.027051:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456000 00000100:00100000:1.0:1784938004.027053:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456000 00000100:00100000:1.0:1784938004.027066:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938004.027076:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5799:x1871643065455744:12345-0@lo:104: 00010000:00010000:1.0:1784938004.027091:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027181:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938004.027189:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5799:x1871643065455744:12345-0@lo:104: Request processed in 114us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.027197:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938004.027239:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938004.027246:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:5799:x1871643065455872:12345-0@lo:104: 00010000:00010000:1.0:1784938004.027260:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027293:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1784938004.027298:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:5799:x1871643065455872:12345-0@lo:104: Request processed in 54us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.027303:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938004.027316:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938004.027321:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5799:x1871643065456000:12345-0@lo:104: 00010000:00010000:1.0:1784938004.027328:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027351:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1784938004.027356:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5799:x1871643065456000:12345-0@lo:104: Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.027361:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1784938004.027380:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938004.027387:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027395:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ef400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938004.027400:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027411:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938004.027420:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938004.027433:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938004.027469:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027477:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938004.027499:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027506:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec348a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027524:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938004.027527:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027532:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938004.027534:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027540:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938004.027545:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938004.027550:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938004.027562:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027567:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938004.027579:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027586:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec341a expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027597:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938004.027600:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027605:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ee800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938004.027608:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027614:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938004.027620:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938004.027625:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938004.027638:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027643:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938004.027659:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027665:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05b021ee800/0xea86628a8aec33f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec33fe expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.027681:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938004.027687:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938004.027689:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938004.027696:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938004.027725:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065456128:0@lo:103: 00000100:00100000:1.0:1784938004.027766:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.027808:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938004.027814:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065456256:0@lo:103: 00000100:00100000:1.0:1784938004.027835:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.027952:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065456384:0@lo:103: 00000100:00100000:1.0:1784938004.027981:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.028025:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456128 00000100:00100000:1.0:1784938004.028031:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456128 00010000:00010000:1.0:1784938004.028057:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3483 expref: 13 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938004.028077:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456256 00000100:00100000:1.0:1784938004.028080:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456256 00010000:00010000:1.0:1784938004.028090:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3413 expref: 14 pid: 5797 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938004.028100:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456384 00000100:00100000:1.0:1784938004.028102:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456384 00010000:00010000:1.0:1784938004.028112:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 15 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938004.028124:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938004.028130:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:3321:x1871643065456128:12345-0@lo:103: 00010000:00010000:1.0:1784938004.028143:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938004.028148:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3483 expref: 15 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028165:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3483 expref: 15 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028185:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938004.028244:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:3321:x1871643065456128:12345-0@lo:103: Request processed in 84us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.028252:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1784938004.028267:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938004.028273:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:3321:x1871643065456256:12345-0@lo:103: 00010000:00010000:1.0:1784938004.028280:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938004.028283:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3413 expref: 14 pid: 5797 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028292:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3413 expref: 14 pid: 5797 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028301:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938004.028321:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:3321:x1871643065456256:12345-0@lo:103: Request processed in 49us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.028327:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1784938004.028338:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938004.028346:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3323:x1871643065456384:12345-0@lo:103: 00010000:00010000:1.0:1784938004.028353:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938004.028356:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 13 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028365:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 13 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028384:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028393:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028409:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028416:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028423:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028429:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028434:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938004.028440:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028449:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028457:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.028466:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938004.028493:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3323:x1871643065456384:12345-0@lo:103: Request processed in 150us (511us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.028508:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1784938004.028559:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065456384:0@lo:103: 00000100:00100000:1.0:1784938004.028591:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065456256:0@lo:103: 00000100:00100000:1.0:1784938004.028598:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065456128:0@lo:103: 00010000:00010000:2.0:1784938004.028712:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892a00/0xea86628a8aec348a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3483 expref: 12 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.028725:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5799:1871643065455744:0@lo:104: 00010000:00010000:2.0:1784938004.028736:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05b021ee200/0xea86628a8aec341a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3413 expref: 11 pid: 5797 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.028744:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5799:1871643065455872:0@lo:104: 00010000:00010000:2.0:1784938004.028754:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11a200/0xea86628a8aec33fe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec33f7 expref: 10 pid: 5798 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.028763:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5799:1871643065456000:0@lo:104: 00010000:00010000:2.0:1784938004.028795:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.028806:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.028812:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.028818:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892400/0xea86628a8aec34e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938004.028836:0:5799:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1784938004.069563:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:6601:x1871643065455616:12345-0@lo:253: Request processed in 50890us (51227us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.069582:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784938004.069734:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065455616:0@lo:253: 10000000:01000000:1.0:1784938004.069759:0:6601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1784938004.069763:0:6601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938004.069765:0:6601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1784938004.069767:0:6601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938004.069768:0:6601:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:1.0:1784938004.069769:0:6601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938004.069770:0:6601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938004.069772:0:6601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938004.069773:0:6601:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1784938004.069775:0:6601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938004.069777:0:6601:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784938004.069816:0:6601:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa05ac73fb000 from lustre-OST0000 10000000:01000000:1.0:1784938004.069853:0:6601:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:1.0:1784938004.069857:0:6601:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784938004.069878:0:6601:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa05ae17299c0 local copy 10000000:01000000:1.0:1784938004.069885:0:6601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938004.069941:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.069954:0:6601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.069965:0:6601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938004.070013:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456512:0@lo:101: 00000100:00100000:1.0:1784938004.070062:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.070131:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.070269:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456512 00000100:00100000:0.0:1784938004.070277:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456512 00000100:00100000:0.0:1784938004.070331:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1784938004.070341:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+9:6601:x1871643065456512:12345-0@lo:101: 00010000:00010000:0.0:1784938004.070359:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938004.070376:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030000/0xea86628a8aec34f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec34ec expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.070405:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030000/0xea86628a8aec34f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec34ec expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.070419:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030000/0xea86628a8aec34f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec34ec expref: 10 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.070430:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938004.070471:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:6601:x1871643065456512:12345-0@lo:101: Request processed in 131us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.070478:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1784938004.070572:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456512:0@lo:101: 00010000:00010000:2.0:1784938004.070587:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.070604:0:6601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.070727:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456640:0@lo:501: 00000100:00100000:2.0:1784938004.070757:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.070793:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5de40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.070851:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456640 00000100:00100000:0.0:1784938004.070872:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456640 00000100:00100000:0.0:1784938004.070906:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1784938004.070912:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:6601:x1871643065456640:12345-0@lo:501: 00000100:00100000:0.0:1784938004.071158:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:6601:x1871643065456640:12345-0@lo:501: Request processed in 247us (401us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938004.071166:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938004.071307:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456640:0@lo:501: 10000000:01000000:2.0:1784938004.071327:0:6601:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1784938004.071352:0:6601:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1784938004.071358:0:6601:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071366:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071373:0:6601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071399:0:6601:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784938004.071419:0:6601:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa05ac73fb000 10000000:01000000:2.0:1784938004.071425:0:6601:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1784938004.071429:0:6601:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa05ae17299c0 10000000:01000000:2.0:1784938004.071432:0:6601:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1784938004.071435:0:6601:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffffa05ae17299c0 from 1 10000000:01000000:2.0:1784938004.071438:0:6601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1784938004.071458:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071475:0:6601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071484:0:6601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.071498:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456768:0@lo:101: 00000100:00100000:2.0:1784938004.071525:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.071543:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938004.071616:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456768 00000100:00100000:1.0:1784938004.071621:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456768 00000100:00100000:1.0:1784938004.071659:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784938004.071667:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+10:6601:x1871643065456768:12345-0@lo:101: 00010000:00010000:1.0:1784938004.071675:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938004.071690:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac1480600/0xea86628a8aec3501 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec34fa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.071708:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac1480600/0xea86628a8aec3501 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec34fa expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.071717:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac1480600/0xea86628a8aec3501 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec34fa expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.071724:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac1480600, rc 0) 00000100:00100000:1.0:1784938004.071753:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:6601:x1871643065456768:12345-0@lo:101: Request processed in 88us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.071758:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1784938004.071843:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456768:0@lo:101: 00010000:00010000:2.0:1784938004.071854:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071873:0:6601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938004.071890:0:6601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1784938004.071904:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071910:0:6601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938004.071917:0:6601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1784938004.071920:0:6601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938004.071924:0:6601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1784938004.071926:0:6601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1784938004.071940:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071953:0:6601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.071960:0:6601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.071971:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456896:0@lo:101: 00000100:00100000:2.0:1784938004.071997:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.072008:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938004.072127:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065456896 00000100:00100000:1.0:1784938004.072132:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065456896 00000100:00100000:1.0:1784938004.072162:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784938004.072168:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:6601:x1871643065456896:12345-0@lo:101: 00010000:00010000:1.0:1784938004.072176:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938004.072185:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3508 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.072206:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3508 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.072246:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3508 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.072254:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac1480400, rc 0) 00000100:00100000:1.0:1784938004.072282:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065456896:12345-0@lo:101: Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.072289:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1784938004.072359:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938004.072367:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.072375:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1480e00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1784938004.072379:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.072387:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938004.072394:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938004.072400:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938004.072424:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.072430:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938004.072454:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.072460:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec34ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea86628a8aec34f3 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.072486:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938004.072489:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938004.072490:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938004.072535:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065457024:0@lo:103: 00000100:00100000:1.0:1784938004.072567:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.072702:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065456896:0@lo:101: 00010000:00010000:2.0:1784938004.072713:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.072720:0:6601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.072826:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457152:0@lo:501: 00000100:00100000:2.0:1784938004.072853:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.072879:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1784938004.072977:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457152 00000100:00100000:1.0:1784938004.072983:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457152 00000100:00100000:1.0:1784938004.073020:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784938004.073027:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457152:12345-0@lo:501: 00000100:00100000:1.0:1784938004.073342:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457152:12345-0@lo:501: Request processed in 315us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.073349:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1784938004.073534:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457152:0@lo:501: 00000100:00100000:2.0:1784938004.073568:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457280:0@lo:503: 00000100:00100000:2.0:1784938004.073609:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.073638:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938004.073696:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457280 00000100:00100000:3.0:1784938004.073702:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457280 00000100:00100000:3.0:1784938004.073742:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1784938004.073749:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457280:12345-0@lo:503: 00000100:00100000:3.0:1784938004.073970:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457280:12345-0@lo:503: Request processed in 220us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938004.073978:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1784938004.074141:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457280:0@lo:503: 00000040:00080000:2.0:1784938004.074606:0:6601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938004.074712:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457408:0@lo:502: 00000100:00100000:2.0:1784938004.074767:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.074809:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938004.075161:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457408 00000100:00100000:3.0:1784938004.075169:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457408 00000100:00100000:3.0:1784938004.075252:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1784938004.075261:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457408:12345-0@lo:502: 00000100:00100000:3.0:1784938004.075492:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457408:12345-0@lo:502: Request processed in 231us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938004.075500:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1784938004.075656:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457408:0@lo:502: 00000040:00080000:2.0:1784938004.076058:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1784938004.076115:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1784938004.076152:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1784938004.076201:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1784938004.076276:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1784938004.076310:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1784938004.076352:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457536:0@lo:502: 00000100:00100000:2.0:1784938004.076414:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.076508:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.076623:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457024 00000100:00100000:0.0:1784938004.076631:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457024 00000100:00100000:0.0:1784938004.076696:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1784938004.076707:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:3324:x1871643065457024:12345-0@lo:103: 00010000:00010000:0.0:1784938004.076722:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938004.076751:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030000/0xea86628a8aec34f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec34ec expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.076774:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938004.076832:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:3324:x1871643065457024:12345-0@lo:103: Request processed in 127us (4263us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.076839:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938004.077056:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457536 00000100:00100000:1.0:1784938004.077061:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457536 00000100:00100000:1.0:1784938004.077135:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938004.077143:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:6601:x1871643065457536:12345-0@lo:502: 00000100:00100000:1.0:1784938004.077413:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:6601:x1871643065457536:12345-0@lo:502: Request processed in 270us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.077420:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1784938004.077527:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457536:0@lo:502: 00000040:00080000:2.0:1784938004.077674:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1784938004.077689:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1784938004.078412:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938004.078424:0:6619:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1784938004.078433:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938004.078435:0:6619:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784938004.078441:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938004.078462:0:6619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa05ad1a20000) 00000020:00000080:2.0:1784938004.078489:0:6619:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784938004.078495:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784938004.078577:0:6619:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05ac73fb000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784938004.078586:0:6619:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938004.078594:0:6619:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea86628a8aec351d 00000100:00100000:0.0:1784938004.082118:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065457024:0@lo:103: 00010000:00010000:2.0:1784938004.085091:0:6619:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1784938004.085649:0:6619:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1784938004.088849:0:6619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784938004.089484:0:6619:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1784938004.097038:0:6619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784938004.097716:0:6619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784938004.099459:0:6619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784938004.099478:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938004.099487:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938004.099490:0:6619:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784938004.099494:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938004.099499:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938004.099500:0:6619:0:(obd_config.c:1561:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938004.099503:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938004.099505:0:6619:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784938004.099578:0:6619:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938004.099583:0:6619:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938004.099584:0:6619:0:(obd_config.c:1561:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938004.099588:0:6619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784938004.099767:0:6601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1784938004.099812:0:6601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1784938004.099842:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.099857:0:6601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938004.099875:0:6601:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac73fb000 from 1 10000000:01000000:1.0:1784938004.099878:0:6601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938004.099936:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.099945:0:6601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.099958:0:6601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938004.099988:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457664:0@lo:101: 00000100:00100000:1.0:1784938004.100088:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.100142:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938004.100317:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457664 00000100:00100000:2.0:1784938004.100326:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457664 00000100:00100000:2.0:1784938004.100380:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938004.100390:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:6601:x1871643065457664:12345-0@lo:101: 00010000:00010000:2.0:1784938004.100407:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938004.100423:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3524 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.100452:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3524 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.100464:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3524 expref: 12 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.100475:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893a00, rc 0) 00000100:00100000:2.0:1784938004.100532:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457664:12345-0@lo:101: Request processed in 143us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938004.100539:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1784938004.100728:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457664:0@lo:101: 00010000:00010000:1.0:1784938004.100745:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.100755:0:6601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938004.100891:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457792:0@lo:501: 00000100:00100000:1.0:1784938004.100927:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.100956:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938004.101059:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457792 00000100:00100000:2.0:1784938004.101063:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457792 00000100:00100000:2.0:1784938004.101096:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1784938004.101102:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457792:12345-0@lo:501: 00000100:00100000:2.0:1784938004.101415:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457792:12345-0@lo:501: Request processed in 312us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938004.101424:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938004.101554:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457792:0@lo:501: 00000100:00100000:1.0:1784938004.101589:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457920:0@lo:503: 00000100:00100000:1.0:1784938004.101632:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.101660:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa559c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938004.101707:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065457920 00000100:00100000:2.0:1784938004.101712:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065457920 00000100:00100000:2.0:1784938004.101772:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784938004.101791:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457920:12345-0@lo:503: 00000100:00100000:2.0:1784938004.101995:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065457920:12345-0@lo:503: Request processed in 215us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938004.102002:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1784938004.102076:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065457920:0@lo:503: 00000040:00080000:0.0:1784938004.102481:0:6601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1784938004.102557:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458048:0@lo:502: 00000100:00100000:0.0:1784938004.102606:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938004.105399:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458048 00000100:00100000:1.0:1784938004.105420:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458048 00000100:00100000:1.0:1784938004.105486:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1784938004.105498:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065458048:12345-0@lo:502: 00000100:00100000:1.0:1784938004.105847:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065458048:12345-0@lo:502: Request processed in 351us (3239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.105856:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784938004.106025:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac971d180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.106063:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458048:0@lo:502: 00000040:00080000:0.0:1784938004.108554:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1784938004.108674:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1784938004.108739:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458176:0@lo:502: 00000100:00100000:0.0:1784938004.108847:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938004.110024:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac971d180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938004.110109:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458176 00000100:00100000:3.0:1784938004.110120:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458176 00000100:00100000:3.0:1784938004.110796:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1784938004.110811:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065458176:12345-0@lo:502: 00000100:00100000:3.0:1784938004.111152:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065458176:12345-0@lo:502: Request processed in 343us (2303us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938004.111162:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1784938004.113874:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458176:0@lo:502: 00000040:00080000:2.0:1784938004.114133:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1784938004.114154:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1784938004.116707:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938004.116728:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938004.116731:0:6623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1784938004.116741:0:6623:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05ac73fb000 00000020:00000080:1.0:1784938004.116744:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1784938004.116770:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938004.116773:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938004.116774:0:6623:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1784938004.116787:0:6623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784938004.117057:0:6601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784938004.117090:0:6601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938004.117153:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.117168:0:6601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938004.117271:0:6601:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784938004.117275:0:6601:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa05ac73fb000 10000000:01000000:2.0:1784938004.117279:0:6601:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa05ac73fb000 10000000:01000000:2.0:1784938004.117285:0:6601:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938004.117293:0:6601:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac73fb000 from 1 10000000:01000000:2.0:1784938004.117296:0:6601:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938004.117351:0:6601:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.117361:0:6601:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.117373:0:6601:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.117407:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458304:0@lo:101: 00000100:00100000:2.0:1784938004.117507:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.117573:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938004.117701:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458304 00000100:00100000:3.0:1784938004.117710:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458304 00000100:00100000:3.0:1784938004.117776:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1784938004.117796:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065458304:12345-0@lo:101: 00010000:00010000:3.0:1784938004.117814:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938004.117833:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3532 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.117991:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3532 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.118022:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3532 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.118033:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11ae00, rc 0) 00000100:00100000:3.0:1784938004.118126:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458304:12345-0@lo:101: Request processed in 331us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938004.118133:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1784938004.118340:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458304:0@lo:101: 00010000:00010000:2.0:1784938004.118362:0:6601:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.118373:0:6601:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938004.118514:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458432:0@lo:501: 00000100:00100000:2.0:1784938004.118549:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.118634:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938004.118669:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458432 00000100:00100000:3.0:1784938004.118674:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458432 00000100:00100000:3.0:1784938004.118743:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784938004.118752:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458432:12345-0@lo:501: 00000100:00100000:3.0:1784938004.119172:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458432:12345-0@lo:501: Request processed in 420us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938004.119180:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1784938004.119274:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458432:0@lo:501: 00000100:00100000:2.0:1784938004.119309:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458560:0@lo:503: 00000100:00100000:2.0:1784938004.119358:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.119576:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d540 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.119640:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458560 00000100:00100000:0.0:1784938004.119646:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458560 00000100:00100000:0.0:1784938004.119678:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1784938004.119687:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458560:12345-0@lo:503: 00000100:00100000:0.0:1784938004.119905:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458560:12345-0@lo:503: Request processed in 218us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.119912:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784938004.120062:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458560:0@lo:503: 00000040:00080000:2.0:1784938004.120552:0:6601:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1784938004.120652:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458688:0@lo:502: 00000100:00100000:2.0:1784938004.120706:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.120736:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac98810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.120874:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458688 00000100:00100000:0.0:1784938004.120880:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458688 00000100:00100000:0.0:1784938004.120913:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784938004.120922:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458688:12345-0@lo:502: 00000100:00100000:0.0:1784938004.121148:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458688:12345-0@lo:502: Request processed in 226us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.121157:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1784938004.121354:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458688:0@lo:502: 00000040:00080000:2.0:1784938004.121683:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1784938004.121739:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1784938004.121772:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1784938004.121848:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1784938004.121901:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1784938004.121951:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1784938004.121988:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1784938004.122023:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1784938004.122071:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1784938004.122106:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1784938004.122144:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1784938004.122192:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1784938004.122267:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1784938004.122318:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1784938004.122363:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1784938004.122402:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1784938004.122437:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1784938004.122482:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1784938004.122528:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1784938004.122563:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1784938004.122611:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1784938004.122645:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1784938004.122678:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1784938004.122727:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1784938004.122766:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1784938004.122819:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1784938004.122889:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1784938004.122926:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1784938004.122982:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458816:0@lo:502: 00000100:00100000:2.0:1784938004.123072:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.123120:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac98810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.123392:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458816 00000100:00100000:0.0:1784938004.123401:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458816 00000100:00100000:0.0:1784938004.123449:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784938004.123460:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458816:12345-0@lo:502: 00000100:00100000:0.0:1784938004.123728:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065458816:12345-0@lo:502: Request processed in 269us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.123737:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1784938004.123922:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065458816:0@lo:502: 00000040:00080000:2.0:1784938004.124024:0:6601:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1784938004.124036:0:6601:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1784938004.124709:0:6624:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1784938004.124728:0:6624:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa05ac6b24d40) 00000020:00000080:0.0:1784938004.124757:0:6624:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1784938004.125123:0:6624:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05ac73fb000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784938004.125135:0:6624:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05ac73fb000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1784938004.125139:0:6624:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac73fb000 3 00010000:00080000:0.0:1784938004.125181:0:6624:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05affd41000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1784938004.128148:0:6624:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1784938004.128406:0:6624:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1784938004.128452:0:6624:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1784938004.128469:0:6624:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xea86628a8aec3547 00000100:00080000:0.0:1784938004.128488:0:6624:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:0.0:1784938004.128502:0:6624:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa05affd41000 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:0.0:1784938004.128553:0:6624:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05afbeb2d80 x1871643065458944/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938004.128620:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1871643065458944:192.168.201.158@tcp:38: 00000100:00100000:3.0:1784938004.129027:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00080000:0.0:1784938004.129147:0:6624:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1784938004.129244:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065459072:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938004.134947:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938004.134991:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065458944 00000100:00100000:1.0:1784938004.135003:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065458944 00000100:00100000:1.0:1784938004.135041:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459072 00000100:00100000:1.0:1784938004.135044:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459072 00000100:00100000:1.0:1784938004.135084:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938004.135095:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065459072:12345-192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938004.135189:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065459072:12345-192.168.201.158@tcp:400: Request processed in 95us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.135197:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938004.135242:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938004.135248:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1871643065458944:12345-192.168.201.158@tcp:38: 00010000:00080000:1.0:1784938004.135278:0:5806:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1784938004.135322:0:5806:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xea86628a8aec354e 00000004:00100000:1.0:1784938004.135342:0:5806:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1784938004.135387:0:5806:0:(import.c:65:import_set_state_nolock()) ffffa05af4ef8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938004.135422:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871643065458944:12345-192.168.201.158@tcp:38: Request processed in 172us (6398us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938004.135429:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00010000:00080000:1.0:1784938004.138550:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa05afbeb2d80 x1871643065458944/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938004.138568:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938004.138581:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1784938004.138593:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784938004.138600:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784938004.138604:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05affd41000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784938004.138613:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1871643065458944:192.168.201.158@tcp:38: 00000040:00080000:1.0:1784938004.139018:0:6624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1784938004.139168:0:6601:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1784938004.139197:0:6601:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938004.139286:0:6601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938004.139300:0:6601:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784938004.139363:0:6601:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784938004.139366:0:6601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938004.139367:0:6601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938004.139368:0:6601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938004.139370:0:6601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938004.139371:0:6601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938004.139373:0:6601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938004.139374:0:6601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938004.139382:0:6601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938004.139384:0:6601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938004.139385:0:6601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784938004.139389:0:6601:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1784938004.139392:0:6601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784938004.139393:0:6601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938004.139394:0:6601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938004.139395:0:6601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938004.139395:0:6601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938004.139396:0:6601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938004.139397:0:6601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938004.139398:0:6601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938004.139399:0:6601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938004.139400:0:6601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938004.139401:0:6601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784938004.139432:0:6601:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1784938004.139454:0:6601:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065459200:0@lo:253: 00000100:00100000:2.0:1784938004.139543:0:6601:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938004.139584:0:6601:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac98810c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.140127:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459200 00000100:00100000:0.0:1784938004.140138:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459200 00000100:00100000:0.0:1784938004.140198:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1784938004.140208:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6601:x1871643065459200:12345-0@lo:253: 20000000:01000000:0.0:1784938004.140267:0:5798:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1784938004.140284:0:5798:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1784938004.141566:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa05afbeb2680 x1871643065459072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938004.141588:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065459072:192.168.201.158@tcp:400: 20000000:01000000:0.0:1784938004.173146:0:5798:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938004.173206:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1784938004.177628:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938004.177646:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938004.177679:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.177705:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec34ad expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.177741:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.177809:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec34ad expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.177826:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec34ad expref: 13 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938004.177843:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1871643065459328:0@lo:104: 00000100:00100000:3.0:1784938004.177957:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938004.178240:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938004.178786:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459328 00000100:00100000:0.0:1784938004.178800:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459328 00000100:00100000:0.0:1784938004.178887:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938004.178898:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5820:x1871643065459328:12345-0@lo:104: 00010000:00010000:0.0:1784938004.178918:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.179012:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938004.179030:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5820:x1871643065459328:12345-0@lo:104: Request processed in 134us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.179038:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1784938004.179181:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1871643065459328:0@lo:104: 00010000:00010000:2.0:1784938004.179207:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.180400:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938004.180416:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.180442:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938004.180446:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.180456:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938004.180464:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938004.180470:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938004.180522:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.180530:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938004.180550:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.180557:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec34ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec34b4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938004.180577:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938004.180579:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938004.180581:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938004.180749:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938004.180772:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065459456:0@lo:103: 00000100:00100000:3.0:1784938004.180874:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938004.181828:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459456 00000100:00100000:0.0:1784938004.181841:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459456 00010000:00010000:0.0:1784938004.181891:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec34ad expref: 14 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938004.181926:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938004.181934:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:3321:x1871643065459456:12345-0@lo:103: 00010000:00010000:0.0:1784938004.181950:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938004.181956:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec34ad expref: 14 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.181969:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec34ad expref: 14 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.181987:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec34b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec34ad expref: 14 pid: 5797 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182008:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182018:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938004.182035:0:5792:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004392170s 00010000:00010000:0.0:1784938004.182040:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182047:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182067:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182075:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182081:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938004.182085:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182093:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182114:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938004.182125:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938004.182188:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065459456:12345-0@lo:103: Request processed in 253us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.182196:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1784938004.182438:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065459456:0@lo:103: 00010000:00010000:3.0:1784938004.182469:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.182481:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938004.182487:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3555 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938004.183327:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:6601:x1871643065459200:12345-0@lo:253: Request processed in 43115us (43779us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938004.183340:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1784938004.183430:0:6601:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6601:1871643065459200:0@lo:253: 10000000:01000000:2.0:1784938004.183444:0:6601:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1784938004.183448:0:6601:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938004.183450:0:6601:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1784938004.183452:0:6601:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938004.183453:0:6601:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938004.183455:0:6601:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938004.183456:0:6601:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938004.183458:0:6601:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938004.183459:0:6601:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938004.183461:0:6601:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938004.183463:0:6601:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938004.183465:0:6601:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938004.183495:0:6601:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784938004.191562:0:6601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938004.191796:0:6601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938004.192018:0:6601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938004.192256:0:6601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938004.192443:0:6601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938004.192689:0:6601:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784938004.194429:0:6601:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1784938004.347017:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1784938004.508854:0:6601:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1784938004.508963:0:6601:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1784938004.509009:0:6601:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784938004.509103:0:6601:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784938004.511043:0:6601:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1784938004.511091:0:6601:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1784938005.362790:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938006.385523:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938007.409602:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1784938007.666951:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1784938007.666962:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac735f800 from 21 10000000:01000000:1.0:1784938007.666969:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938007.667034:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.667049:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.667063:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938007.667094:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065459584:0@lo:101: 00000100:00100000:1.0:1784938007.667193:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.667284:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa556c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.667369:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459584 00000100:00100000:3.0:1784938007.667379:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459584 00000100:00100000:3.0:1784938007.667465:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784938007.667476:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065459584:12345-0@lo:101: 00010000:00010000:3.0:1784938007.667505:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938007.667524:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec355c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.667552:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec355c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.667566:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec355c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.667576:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b400, rc 0) 00000100:00100000:3.0:1784938007.667625:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065459584:12345-0@lo:101: Request processed in 150us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.667632:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784938007.667688:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065459584:0@lo:101: 00010000:00010000:3.0:1784938007.667732:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.667741:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938007.667810:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065459712:0@lo:501: 00000100:00100000:3.0:1784938007.667833:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938007.667852:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.667864:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459712 00000100:00100000:3.0:1784938007.667868:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459712 00000100:00100000:3.0:1784938007.667886:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784938007.667891:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065459712:12345-0@lo:501: 00000100:00100000:3.0:1784938007.668328:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065459712:12345-0@lo:501: Request processed in 434us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.668337:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1784938007.668471:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065459712:0@lo:501: 00000100:00100000:3.0:1784938007.668499:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065459840:0@lo:503: 00000100:00100000:3.0:1784938007.668538:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938007.668551:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.668563:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459840 00000100:00100000:3.0:1784938007.668567:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459840 00000100:00100000:3.0:1784938007.668586:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938007.668592:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065459840:12345-0@lo:503: 00000100:00100000:3.0:1784938007.668888:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065459840:12345-0@lo:503: Request processed in 295us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.668895:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938007.668940:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065459840:0@lo:503: 00000100:00100000:3.0:1784938007.670671:0:6778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6778:1871643065459968:0@lo:502: 00000100:00100000:3.0:1784938007.670772:0:6778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938007.671501:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065459968 00000100:00100000:3.0:1784938007.671513:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065459968 00000100:00100000:3.0:1784938007.671569:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938007.671579:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6778:x1871643065459968:12345-0@lo:502: 00000100:00100000:3.0:1784938007.673138:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6778:x1871643065459968:12345-0@lo:502: Request processed in 1549us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.673154:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938007.673271:0:6778:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13accc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.673314:0:6778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6778:1871643065459968:0@lo:502: 00000100:00100000:3.0:1784938007.675934:0:6778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6778:1871643065460096:0@lo:502: 00000100:00100000:3.0:1784938007.676044:0:6778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938007.676939:0:6778:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938007.681354:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460096 00000100:00100000:1.0:1784938007.681374:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460096 00000100:00100000:1.0:1784938007.681475:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784938007.681489:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6778:x1871643065460096:12345-0@lo:502: 00000100:00100000:1.0:1784938007.682954:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:6778:x1871643065460096:12345-0@lo:502: Request processed in 1456us (6897us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938007.682970:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1784938007.686979:0:6778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6778:1871643065460096:0@lo:502: 00000040:00080000:3.0:1784938007.687105:0:6778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1784938007.687341:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1784938007.687363:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938007.687376:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938007.687415:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938007.687427:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938007.687430:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05ac735f800 from 4 10000000:01000000:0.0:1784938007.687433:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938007.687483:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938007.687492:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938007.687504:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938007.687525:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460224:0@lo:101: 00000100:00100000:0.0:1784938007.687601:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938007.687648:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac971dcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.687764:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460224 00000100:00100000:3.0:1784938007.687775:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460224 00000100:00100000:3.0:1784938007.687852:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784938007.687864:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065460224:12345-0@lo:101: 00010000:00010000:3.0:1784938007.687882:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938007.687900:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec356a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.687926:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec356a expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.687937:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec356a expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.687948:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a200, rc 0) 00000100:00100000:3.0:1784938007.688001:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065460224:12345-0@lo:101: Request processed in 140us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.688009:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784938007.688088:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460224:0@lo:101: 00010000:00010000:1.0:1784938007.688103:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688112:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938007.688169:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460352:0@lo:256: 00000100:00100000:1.0:1784938007.688203:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.688256:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.688390:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460352 00000100:00100000:3.0:1784938007.688405:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460352 00000100:00100000:3.0:1784938007.688435:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1784938007.688442:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065460352:12345-0@lo:256: 20000000:01000000:3.0:1784938007.688458:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938007.688483:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938007.688486:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1784938007.688562:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065460352:12345-0@lo:256: Request processed in 119us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.688569:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784938007.688685:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460352:0@lo:256: 10000000:01000000:1.0:1784938007.688743:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938007.688749:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688758:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938007.688765:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784938007.688767:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1784938007.688770:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784938007.688789:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688811:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688818:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938007.688831:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460480:0@lo:101: 00000100:00100000:1.0:1784938007.688856:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.688877:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938007.688890:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460480 00000100:00100000:1.0:1784938007.688899:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460480 00000100:00100000:1.0:1784938007.688918:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784938007.688923:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065460480:12345-0@lo:101: 00010000:00010000:1.0:1784938007.688931:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938007.688943:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3578 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688960:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3578 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688968:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3578 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.688976:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac1481800, rc 0) 00000100:00100000:1.0:1784938007.689003:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065460480:12345-0@lo:101: Request processed in 79us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938007.689009:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784938007.689035:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460480:0@lo:101: 00010000:00010000:1.0:1784938007.689045:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.689054:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938007.689100:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460608:0@lo:501: 00000100:00100000:1.0:1784938007.689122:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.689135:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938007.689145:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460608 00000100:00100000:1.0:1784938007.689148:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460608 00000100:00100000:1.0:1784938007.689170:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784938007.689176:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065460608:12345-0@lo:501: 00000100:00100000:1.0:1784938007.689524:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065460608:12345-0@lo:501: Request processed in 348us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938007.689532:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784938007.689561:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460608:0@lo:501: 00000100:00100000:1.0:1784938007.689586:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460736:0@lo:503: 00000100:00100000:1.0:1784938007.689626:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.689639:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938007.689650:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460736 00000100:00100000:1.0:1784938007.689652:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460736 00000100:00100000:1.0:1784938007.689668:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784938007.689673:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065460736:12345-0@lo:503: 00000100:00100000:1.0:1784938007.690013:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065460736:12345-0@lo:503: Request processed in 338us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938007.690020:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784938007.690056:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065460736:0@lo:503: 00000100:00100000:1.0:1784938007.690291:0:6779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6779:1871643065460864:0@lo:502: 00000100:00100000:1.0:1784938007.690325:0:6779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.690344:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460864 00000100:00100000:1.0:1784938007.690348:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460864 00000100:00100000:1.0:1784938007.690366:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938007.690373:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:6779:x1871643065460864:12345-0@lo:502: 00000100:00100000:1.0:1784938007.690554:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:6779:x1871643065460864:12345-0@lo:502: Request processed in 181us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938007.690571:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938007.690599:0:6779:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938007.690610:0:6779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6779:1871643065460864:0@lo:502: 00000020:01000000:1.0:1784938007.690632:0:6779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938007.690642:0:6779:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784938007.690650:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938007.690652:0:6779:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1784938007.690658:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938007.690662:0:6779:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1784938007.690687:0:6779:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938007.690689:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938007.690734:0:6779:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa05ae17719c0) 00000020:00000080:1.0:1784938007.690763:0:6779:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1784938007.690770:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938007.690848:0:6779:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1784938007.690854:0:6779:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1784938007.690863:0:6779:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec358d 00010000:00080000:1.0:1784938007.690900:0:6779:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05afd336000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784938007.691159:0:6779:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1784938007.777337:0:6779:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1784938007.777373:0:6779:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1784938007.778135:0:6779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938007.778335:0:6779:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938007.778388:0:6779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1784938007.778453:0:6779:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1784938007.780235:0:6783:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938007.780247:0:6783:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1784938007.781000:0:6779:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938007.781015:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938007.781055:0:6779:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1784938007.781085:0:6779:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec3594 00000100:00080000:2.0:1784938007.781101:0:6779:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:2.0:1784938007.781115:0:6779:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa05afd336000 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:2.0:1784938007.781160:0:6779:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05afbeaf100 x1871643065460992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938007.781245:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065460992:192.168.201.158@tcp:8: 00000100:00080000:2.0:1784938007.782857:0:6779:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1784938007.783014:0:6779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938007.783022:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938007.783024:0:6779:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1784938007.783028:0:6779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938007.783032:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938007.783033:0:6779:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938007.783036:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938007.783045:0:6779:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1784938007.783100:0:6779:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6779:1871643065461120:0@lo:502: 00000100:00100000:2.0:1784938007.783201:0:6779:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938007.783261:0:6779:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7eb4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938007.783309:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461120 00000100:00100000:2.0:1784938007.783316:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461120 00000100:00100000:2.0:1784938007.783365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784938007.783375:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:6779:x1871643065461120:12345-0@lo:502: 00000100:00100000:2.0:1784938007.783656:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:6779:x1871643065461120:12345-0@lo:502: Request processed in 280us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938007.783665:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1784938007.783781:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065461248:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938007.783843:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938007.783849:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065461376:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938007.784042:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938007.784126:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938007.784147:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938007.784177:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065460992 00000100:00100000:2.0:1784938007.784182:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065460992 00000100:00100000:2.0:1784938007.784205:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938007.784210:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065460992:12345-192.168.201.158@tcp:8: 00010000:00080000:2.0:1784938007.784262:0:6602:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 216 last 0 00000020:00000080:2.0:1784938007.784294:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec359b 00002000:00100000:2.0:1784938007.784340:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa05ac6a42800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784938007.784345:0:6602:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1784938007.784350:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1784938007.784489:0:6602:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1784938007.784626:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784938007.784661:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa05af4efa000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938007.784710:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1871643065460992:12345-192.168.201.158@tcp:8: Request processed in 498us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938007.784729:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938007.784756:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461248 00000100:00100000:2.0:1784938007.784760:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461248 00000100:00100000:2.0:1784938007.784789:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461376 00000100:00100000:2.0:1784938007.784792:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461376 00000100:00100000:2.0:1784938007.784821:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:2.0:1784938007.784826:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065461248:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938007.784860:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065461248:12345-192.168.201.158@tcp:400: Request processed in 33us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938007.784866:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:2.0:1784938007.784878:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:2.0:1784938007.784884:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065461376:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938007.784908:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065461376:12345-192.168.201.158@tcp:400: Request processed in 24us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938007.784913:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00080000:2.0:1784938007.784942:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938007.785467:0:6779:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:6779:1871643065461120:0@lo:502: 00000020:01000000:3.0:1784938007.785513:0:6779:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938007.785520:0:6779:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938007.785523:0:6779:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784938007.785530:0:6779:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:1.0:1784938007.785898:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1784938007.785921:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938007.785934:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.785947:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938007.785959:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938007.785974:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa05ae17299c0 from 1 10000000:01000000:1.0:1784938007.785978:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938007.786017:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.786025:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938007.786035:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938007.786054:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065461504:0@lo:101: 00000100:00100000:1.0:1784938007.786108:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938007.786201:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa559c0 going to sleep for 11 seconds 00010000:00080000:1.0:1784938007.786260:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeaed80 x1871643065461376/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938007.786273:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065461376:192.168.201.158@tcp:400: 00010000:00080000:1.0:1784938007.786284:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbead880 x1871643065461248/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938007.786293:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065461248:192.168.201.158@tcp:400: 00010000:00080000:0.0:1784938007.791971:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeaf100 x1871643065460992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938017 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938007.791991:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938007.792003:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938007.792014:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938007.792021:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938007.792041:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05afd336000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938007.792071:0:3320:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938007.792079:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065460992:192.168.201.158@tcp:8: 00000004:00080000:0.0:1784938007.792168:0:6783:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938007.792386:0:6783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 216735169283ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784938007.796975:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461504 00000100:00100000:3.0:1784938007.796997:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461504 00000100:00100000:3.0:1784938007.797078:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784938007.797091:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065461504:12345-0@lo:101: 00010000:00010000:3.0:1784938007.797116:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938007.797141:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec35a2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.797178:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.797192:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.797204:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a000, rc 0) 00000100:00100000:3.0:1784938007.797339:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065461504:12345-0@lo:101: Request processed in 251us (11229us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.797347:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1784938007.797406:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065461504:0@lo:101: 00010000:00010000:3.0:1784938007.797437:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938007.797447:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938007.797529:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065461632:0@lo:501: 00000100:00100000:3.0:1784938007.797570:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938007.797602:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461632 00000100:00100000:2.0:1784938007.797608:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461632 00000100:00100000:2.0:1784938007.797630:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784938007.797637:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065461632:12345-0@lo:501: 00000100:00100000:3.0:1784938007.797842:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938007.802316:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065461632:12345-0@lo:501: Request processed in 4567us (4634us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938007.802345:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1784938007.802450:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065461632:0@lo:501: 10000000:01000000:2.0:1784938007.802503:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1784938007.802518:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938007.802531:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938007.890272:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:3.0:1784938007.941196:0:6784:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:3.0:1784938007.941280:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb423100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065461888:192.168.201.158@tcp:7: 00000100:00100000:3.0:1784938007.941420:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938007.941626:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938007.941673:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461888 00000100:00100000:3.0:1784938007.941682:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461888 00000100:00100000:3.0:1784938007.941769:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:3.0:1784938007.941780:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1871643065461888:12345-192.168.201.158@tcp:7: 00000100:00100000:1.0:1784938007.941904:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938007.941919:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065461760:192.168.201.158@tcp:13: 00000100:00080000:2.0:1784938007.943948:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938007.944302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938007.944435:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065461760 00000100:00100000:1.0:1784938007.944450:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065461760 00000100:00100000:1.0:1784938007.944515:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938007.944528:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871643065461760:12345-192.168.201.158@tcp:13: 00002000:00000024:1.0:1784938007.944575:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1784938007.944670:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871643065461760:12345-192.168.201.158@tcp:13: Request processed in 145us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938007.944679:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00010000:00080000:1.0:1784938007.947493:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afb423b80 x1871643065461760/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938023 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938007.947527:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065461760:192.168.201.158@tcp:13: 00002000:00080000:3.0:1784938007.954627:0:6605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1784938007.954638:0:6605:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1784938007.954766:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1871643065461888:12345-192.168.201.158@tcp:7: Request processed in 12977us (13131us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938007.954779:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:2.0:1784938007.955258:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afb423100 x1871643065461888/t0(0) o7->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938023 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938007.955278:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb423100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065461888:192.168.201.158@tcp:7: 00000004:00080000:2.0:1784938007.955295:0:6784:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1784938007.955568:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065462016:192.168.201.158@tcp:5: 00000100:00100000:2.0:1784938007.955678:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae002a180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938007.955909:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938007.955974:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462016 00000100:00100000:1.0:1784938007.955983:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462016 00000100:00100000:1.0:1784938007.956038:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938007.956047:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6784:x1871643065462016:12345-192.168.201.158@tcp:5: 00002000:00080000:1.0:1784938007.956082:0:6604:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1784938007.956086:0:6604:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1784938007.956940:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6784:x1871643065462016:12345-192.168.201.158@tcp:5: Request processed in 889us (1028us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1784938007.956952:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00010000:00080000:1.0:1784938007.957269:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeaea00 x1871643065462016/t0(0) o5->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938023 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938007.957288:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065462016:192.168.201.158@tcp:5: 00000004:00080000:1.0:1784938007.957301:0:6784:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1784938007.957344:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065462144:192.168.201.158@tcp:700: 00000100:00100000:1.0:1784938007.957388:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938007.957670:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938007.957956:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462144 00000100:00100000:1.0:1784938007.957965:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462144 00000100:00100000:1.0:1784938007.958015:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938007.958025:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6784:x1871643065462144:12345-192.168.201.158@tcp:700: 00000100:00100000:1.0:1784938007.958087:0:6611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6611:1871643065462272:192.168.201.158@tcp:700: 00000100:00100000:1.0:1784938007.958132:0:6611:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa559c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938007.958317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938007.958440:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462272 00000100:00100000:1.0:1784938007.958445:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462272 00000100:00100000:1.0:1784938007.958485:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938007.958492:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6611:x1871643065462272:12345-192.168.201.158@tcp:700: 40000000:02000000:3.0:1784938007.994729:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1784938008.002074:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6611:x1871643065462272:12345-192.168.201.158@tcp:700: Request processed in 43564us (43739us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938008.002100:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00010000:00080000:1.0:1784938008.005410:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05ac83e7480 x1871643065462272/t0(0) o700->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938023 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938008.005436:0:6611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6611:1871643065462272:192.168.201.158@tcp:700: 40000000:02000000:1.0:1784938008.005454:0:6611:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1784938008.090248:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1784938008.090270:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1784938008.090961:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6784:x1871643065462144:12345-192.168.201.158@tcp:700: Request processed in 132924us (133278us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938008.090990:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00010000:00080000:3.0:1784938008.091426:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05ac83e4700 x1871643065462144/t0(0) o700->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938023 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938008.091442:0:6784:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784938008.091467:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065462144:192.168.201.158@tcp:700: 00000004:02000040:3.0:1784938008.116283:0:6784:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1784938008.121052:0:6784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065462400:192.168.201.158@tcp:5: 00000100:00100000:3.0:1784938008.121692:0:6784:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938008.122246:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938008.122397:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462400 00000100:00100000:0.0:1784938008.122411:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462400 00000100:00100000:0.0:1784938008.122489:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938008.122503:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6784:x1871643065462400:12345-192.168.201.158@tcp:5: 00002000:00080000:1.0:1784938008.143403:0:6605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1784938008.143442:0:6605:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1784938008.148084:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6784:x1871643065462400:12345-192.168.201.158@tcp:5: Request processed in 25568us (25860us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1784938008.148102:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00010000:00080000:0.0:1784938008.148685:0:6784:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afb422d80 x1871643065462400/t0(0) o5->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938024 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938008.148722:0:6784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6784:1871643065462400:192.168.201.158@tcp:5: 00000004:00080000:0.0:1784938008.148744:0:6784:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1784938008.436933:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938009.459936:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938010.481610:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938011.505340:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938012.199976:0:6972:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784938012.530710:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938013.233676:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065462528:192.168.201.158@tcp:13: 00000100:00100000:2.0:1784938013.237813:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065462784:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938013.237955:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065462656:0@lo:400: 00000100:00100000:0.0:1784938013.238128:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938013.239026:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065462912:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938013.239391:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938013.239452:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462528 00000100:00100000:1.0:1784938013.239463:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462528 00000100:00100000:1.0:1784938013.239535:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:1.0:1784938013.239548:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1871643065462528:12345-192.168.201.158@tcp:13: 00002000:00000024:1.0:1784938013.239591:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938013.239656:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3322:x1871643065462528:12345-192.168.201.158@tcp:13: Request processed in 111us (1529us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938013.239681:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:1.0:1784938013.239714:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462656 00000100:00100000:1.0:1784938013.239717:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462656 00000100:00100000:1.0:1784938013.239746:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784938013.239753:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065462656:12345-0@lo:400: 00000100:00100000:1.0:1784938013.239797:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065462656:12345-0@lo:400: Request processed in 44us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938013.239804:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1784938013.239837:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938013.239879:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065462656:0@lo:400: 00000100:00100000:3.0:1784938013.240492:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938013.240573:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462784 00000100:00100000:2.0:1784938013.240579:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462784 00000100:00100000:2.0:1784938013.240618:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:3.0:1784938013.240619:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938013.240637:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065462784:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938013.240688:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065462784:12345-192.168.201.158@tcp:400: Request processed in 52us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938013.240696:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:2.0:1784938013.240709:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065462912 00000100:00100000:2.0:1784938013.240712:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065462912 00000100:00100000:2.0:1784938013.240746:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:2.0:1784938013.240752:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065462912:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938013.240777:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065462912:12345-192.168.201.158@tcp:400: Request processed in 25us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938013.240785:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00010000:00080000:1.0:1784938013.241178:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb1180 x1871643065462528/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938013.241204:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065462528:192.168.201.158@tcp:13: 00000100:00080000:3.0:1784938013.241489:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784938013.241562:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeaca80 x1871643065462912/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938013.241574:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065462912:192.168.201.158@tcp:400: 00010000:00080000:3.0:1784938013.241863:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeadc00 x1871643065462784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938013.241875:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065462784:192.168.201.158@tcp:400: 00000001:00080000:3.0:1784938013.420183:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1784938013.559043:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938014.577496:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938015.601762:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938016.625884:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938017.651776:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938018.353421:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065463040:192.168.201.158@tcp:13: 00000100:00100000:1.0:1784938018.353877:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938018.353915:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463040 00000100:00100000:1.0:1784938018.353926:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463040 00000100:00100000:1.0:1784938018.354808:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938018.354826:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065463040:12345-192.168.201.158@tcp:13: 00002000:00000024:1.0:1784938018.354884:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938018.354963:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065463040:12345-192.168.201.158@tcp:13: Request processed in 141us (1088us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938018.354971:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00080000:3.0:1784938018.355326:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938018.356936:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05ac83e7480 x1871643065463040/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938034 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938018.356956:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1784938018.356993:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065463040:192.168.201.158@tcp:13: 00000100:00100000:0.0:1784938018.359951:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065463168:0@lo:400: 00000100:00100000:0.0:1784938018.361312:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938018.361402:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938018.361421:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065463296:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938018.361529:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065463424:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938018.362183:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463168 00000100:00100000:2.0:1784938018.362195:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463168 00000100:00100000:0.0:1784938018.362962:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938018.362993:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938018.363342:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784938018.363355:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065463168:12345-0@lo:400: 00000100:00100000:2.0:1784938018.363442:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065463168:12345-0@lo:400: Request processed in 90us (2139us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938018.363451:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784938018.363499:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463296 00000100:00100000:2.0:1784938018.363506:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463296 00000100:00100000:2.0:1784938018.363547:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463424 00000100:00100000:2.0:1784938018.363550:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463424 00000100:00100000:2.0:1784938018.363601:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:2.0:1784938018.363608:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065463296:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938018.364499:0:5805:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1784938018.364514:0:5805:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1784938018.365575:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065463296:12345-192.168.201.158@tcp:400: Request processed in 1953us (2605us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938018.365589:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:0.0:1784938018.365795:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:0.0:1784938018.365810:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065463424:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938018.365865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065463424:12345-192.168.201.158@tcp:400: Request processed in 61us (2872us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938018.365872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 8 00010000:00080000:0.0:1784938018.366000:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb1180 x1871643065463424/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1784938018.366104:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb0700 x1871643065463296/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938018.366122:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065463296:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938018.366138:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065463168:0@lo:400: 00000100:00080000:3.0:1784938018.367495:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938018.368139:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065463424:192.168.201.158@tcp:400: 00010000:00010000:0.0:1784938018.674864:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938019.699196:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938020.728766:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938021.752199:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938022.769610:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938023.120871:0:7491:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938023.120878:0:7491:0:(obd_mount.c:922:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784938023.121033:0:7491:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa05ac7f16000 00000020:01000004:3.0:1784938023.121054:0:7491:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1784938023.121070:0:7491:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784938023.121093:0:7491:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa05ad094b380) 00000020:00000080:3.0:1784938023.121113:0:7491:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784938023.135118:0:7491:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1784938023.135669:0:7491:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1784938023.165192:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1784938023.172447:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784938023.172709:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1784938023.172774:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784938023.172803:0:7491:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1784938023.173443:0:7491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1784938023.173623:0:7491:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1784938023.173707:0:7491:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea86628a8aec35b7 00000020:01000004:1.0:1784938023.173718:0:7491:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1784938023.173756:0:7491:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1784938023.173761:0:7491:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1784938023.173769:0:7491:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1784938023.173800:0:7491:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1784938023.173806:0:7491:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1784938023.203759:0:7491:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784938023.203830:0:7491:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.158@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1784938023.203835:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784938023.203837:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784938023.203839:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938023.203840:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938023.203842:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938023.203849:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938023.203851:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938023.203853:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938023.203854:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938023.203856:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938023.203858:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938023.203863:0:7491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1784938023.204982:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938023.204984:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784938023.204985:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938023.204987:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938023.204988:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938023.204990:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938023.204992:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938023.204993:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1784938023.204994:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1784938023.204996:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938023.204997:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938023.205042:0:7491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1784938023.205070:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065463552:0@lo:253: 00000100:00100000:0.0:1784938023.205185:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938023.205413:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938023.206261:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463552 00000100:00100000:1.0:1784938023.206277:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463552 00000100:00100000:1.0:1784938023.206441:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784938023.206464:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:7491:x1871643065463552:12345-0@lo:253: 20000000:01000000:1.0:1784938023.206564:0:5798:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1784938023.206570:0:5798:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1784938023.206576:0:5798:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1784938023.206580:0:5798:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1784938023.209309:0:5798:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938023.209582:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1784938023.209600:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1784938023.209644:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1784938023.209653:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1784938023.209687:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1784938023.209739:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1784938023.210151:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1784938023.210176:0:5798:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:1.0:1784938023.210178:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:1.0:1784938023.210259:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1784938023.210268:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1784938023.210321:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1784938023.210329:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:1.0:1784938023.210361:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1784938023.210371:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1784938023.210404:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1784938023.211842:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1784938023.212999:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1784938023.213025:0:5798:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:2.0:1784938023.213027:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:2.0:1784938023.213048:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1784938023.213052:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1784938023.213067:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1784938023.213071:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:2.0:1784938023.213087:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1784938023.213093:0:5798:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1784938023.213115:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1784938023.213134:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1784938023.213406:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1784938023.213410:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1784938023.213419:0:5798:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1784938023.213420:0:5798:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1784938023.213423:0:5798:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1784938023.213442:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1784938023.213445:0:5798:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1784938023.213740:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1784938023.213743:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:2.0:1784938023.221012:0:7493:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1784938023.221657:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1784938023.221714:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1784938023.221814:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1784938023.221833:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1784938023.221836:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1784938023.222570:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1784938023.222634:0:7494:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1784938023.222689:0:7494:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1784938023.223284:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1784938023.223332:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1784938023.223401:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1784938023.223416:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1784938023.223418:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1784938023.224204:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1784938023.224364:0:7495:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1784938023.224419:0:7495:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1784938023.225000:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:0.0:1784938023.225064:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:0.0:1784938023.225101:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:0.0:1784938023.225118:0:5798:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784938023.225122:0:5798:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1784938023.226723:0:7496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1784938023.226858:0:7496:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1784938023.226897:0:7496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1784938023.227584:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1784938023.227639:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1784938023.227703:0:5798:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1784938023.227728:0:5798:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1784938023.227756:0:5798:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227783:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3508 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227793:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3532 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227800:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec355c expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227808:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3578 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227815:0:5798:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227823:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227879:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.227911:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.227930:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065463680:0@lo:104: 00000100:00100000:2.0:1784938023.228022:0:5798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938023.231652:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3578 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.231703:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3578 expref: 16 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.231728:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065463808:0@lo:104: 00010000:00010000:2.0:1784938023.231881:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec355c expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.231890:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec355c expref: 16 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.231899:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065463936:0@lo:104: 00010000:00010000:2.0:1784938023.231928:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3532 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.231935:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3532 expref: 16 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.231943:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065464064:0@lo:104: 00010000:00010000:2.0:1784938023.231964:0:5798:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3508 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.231997:0:5798:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3508 expref: 16 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.232005:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065464192:0@lo:104: 00000100:00100000:2.0:1784938023.232027:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938023.232260:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784938023.232299:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.232357:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.232365:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.232373:0:5788:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.232390:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463680 00000100:00100000:3.0:1784938023.232399:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463680 00000100:00100000:3.0:1784938023.232467:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463808 00000100:00100000:3.0:1784938023.232471:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463808 00000100:00100000:3.0:1784938023.232562:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065463936 00000100:00100000:3.0:1784938023.232566:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065463936 00000100:00100000:3.0:1784938023.232575:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464064 00000100:00100000:3.0:1784938023.232578:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464064 00000100:00100000:3.0:1784938023.232586:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464192 00000100:00100000:3.0:1784938023.232588:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464192 00000100:00100000:3.0:1784938023.232602:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938023.232612:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+7:5798:x1871643065463680:12345-0@lo:104: 00010000:00010000:3.0:1784938023.232638:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.232717:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938023.232725:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6ab8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+7:5798:x1871643065463680:12345-0@lo:104: Request processed in 115us (4702us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.232733:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938023.232805:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938023.232813:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+6:5798:x1871643065463808:12345-0@lo:104: 00010000:00010000:3.0:1784938023.232821:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.232857:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784938023.232862:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+6:5798:x1871643065463808:12345-0@lo:104: Request processed in 52us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.232868:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938023.232881:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938023.232886:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5798:x1871643065463936:12345-0@lo:104: 00010000:00010000:3.0:1784938023.232894:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.232922:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1784938023.232927:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb422d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:5798:x1871643065463936:12345-0@lo:104: Request processed in 41us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.232932:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938023.232943:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938023.232950:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:5798:x1871643065464064:12345-0@lo:104: 00010000:00010000:3.0:1784938023.232964:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.232992:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1784938023.232997:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:5798:x1871643065464064:12345-0@lo:104: Request processed in 49us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.233003:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938023.233014:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938023.233020:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5798:x1871643065464192:12345-0@lo:104: 00010000:00010000:3.0:1784938023.233028:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233055:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1784938023.233060:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5798:x1871643065464192:12345-0@lo:104: Request processed in 41us (685us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.233066:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784938023.233088:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784938023.233095:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233103:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1481c00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938023.233108:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233117:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938023.233126:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938023.233143:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938023.233184:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233191:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938023.233241:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233249:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac1481c00/0xea86628a8aec35a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35a9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233271:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938023.233274:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233280:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1481a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938023.233283:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233290:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938023.233296:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938023.233301:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938023.233315:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233321:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938023.233343:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233350:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac1481a00/0xea86628a8aec3578 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec357f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233361:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938023.233364:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233370:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1481e00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938023.233374:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233380:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938023.233386:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938023.233392:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938023.233404:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233411:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938023.233416:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233422:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac1481e00/0xea86628a8aec355c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3563 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233432:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938023.233441:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233446:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938023.233461:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.233468:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.233696:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065464448:0@lo:103: 00000100:00100000:2.0:1784938023.233744:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.233788:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938023.233794:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065464576:0@lo:103: 00000100:00100000:2.0:1784938023.233816:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.233852:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464448 00000100:00100000:2.0:1784938023.233859:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464448 00010000:00010000:2.0:1784938023.233887:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3578 expref: 17 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.233912:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464576 00000100:00100000:2.0:1784938023.233915:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464576 00010000:00010000:2.0:1784938023.233926:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec355c expref: 18 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.233939:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784938023.233945:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:3323:x1871643065464448:12345-0@lo:103: 00010000:00010000:2.0:1784938023.233956:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938023.233960:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3578 expref: 18 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.233970:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3578 expref: 18 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.233999:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938023.234027:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:3323:x1871643065464448:12345-0@lo:103: Request processed in 82us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.234034:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1784938023.234048:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784938023.234053:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:3323:x1871643065464576:12345-0@lo:103: 00010000:00010000:2.0:1784938023.234060:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938023.234064:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec355c expref: 17 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.234072:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec355c expref: 17 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.234081:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938023.234097:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:3323:x1871643065464576:12345-0@lo:103: Request processed in 44us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.234103:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784938023.234138:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065464576:0@lo:103: 00000100:00100000:2.0:1784938023.234146:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065464448:0@lo:103: 00000100:00100000:2.0:1784938023.234174:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065463680:0@lo:104: 00010000:00010000:2.0:1784938023.234182:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac1481800/0xea86628a8aec357f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3578 expref: 16 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.234193:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065463808:0@lo:104: 00010000:00010000:2.0:1784938023.234201:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11b400/0xea86628a8aec3563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec355c expref: 15 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938023.234381:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938023.234391:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1784938023.234472:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeac700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065463936:0@lo:104: 00000100:00100000:2.0:1784938023.234488:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065464064:0@lo:104: 00000100:00100000:2.0:1784938023.234497:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5798:1871643065464192:0@lo:104: 00010000:00010000:2.0:1784938023.234523:0:5798:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234577:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234585:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938023.234593:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234599:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05afc892600/0xea86628a8aec3532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3539 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234613:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938023.234617:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234622:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938023.234625:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234645:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938023.234651:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938023.234656:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938023.234836:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234844:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938023.234849:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234856:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05afc892a00/0xea86628a8aec3508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec350f expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.234873:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938023.234875:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938023.234877:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938023.234885:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938023.234899:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065464320:0@lo:103: 00000100:00100000:3.0:1784938023.234938:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.235045:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065464832:0@lo:103: 00000100:00100000:3.0:1784938023.235067:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.235162:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938023.235168:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065464704:0@lo:103: 00000100:00100000:3.0:1784938023.235190:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.235291:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464320 00000100:00100000:2.0:1784938023.235298:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464320 00010000:00010000:2.0:1784938023.235325:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 15 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.235346:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464832 00000100:00100000:2.0:1784938023.235349:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464832 00010000:00010000:2.0:1784938023.235360:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3508 expref: 16 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.235373:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784938023.235380:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3322:x1871643065464320:12345-0@lo:103: 00010000:00010000:2.0:1784938023.235392:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938023.235396:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235408:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235422:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11a000/0xea86628a8aec35a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec35a2 expref: 16 pid: 5798 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235447:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938023.235488:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:3322:x1871643065464320:12345-0@lo:103: Request processed in 108us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.235495:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1784938023.235510:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938023.235516:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:3322:x1871643065464832:12345-0@lo:103: 00010000:00010000:2.0:1784938023.235524:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938023.235528:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3508 expref: 14 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235536:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3508 expref: 14 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235546:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac1480400/0xea86628a8aec350f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3508 expref: 14 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235556:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938023.235577:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3322:x1871643065464832:12345-0@lo:103: Request processed in 61us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.235583:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1784938023.235738:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065464320:0@lo:103: 00000100:00100000:3.0:1784938023.235748:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065464832:0@lo:103: 00000100:00100000:2.0:1784938023.235813:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464704 00000100:00100000:2.0:1784938023.235822:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464704 00010000:00010000:2.0:1784938023.235837:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3532 expref: 13 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.235895:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1784938023.235902:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3322:x1871643065464704:12345-0@lo:103: 00010000:00010000:2.0:1784938023.235910:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938023.235920:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3532 expref: 13 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235928:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3532 expref: 13 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235937:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11ae00/0xea86628a8aec3539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3532 expref: 13 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235949:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235958:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235974:0:5791:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235982:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235989:0:5791:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.235997:0:5791:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.236003:0:5791:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938023.236007:0:5791:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.236014:0:5791:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.236051:0:5791:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.236062:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938023.236096:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:3322:x1871643065464704:12345-0@lo:103: Request processed in 196us (905us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.236104:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1784938023.236145:0:5798:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.236153:0:5798:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.236160:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892200/0xea86628a8aec35be lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784938023.236175:0:5798:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1784938023.246386:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065464704:0@lo:103: 00000100:00100000:3.0:1784938023.298350:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:7491:x1871643065463552:12345-0@lo:253: Request processed in 91881us (93148us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.298370:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1784938023.298617:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065463552:0@lo:253: 10000000:01000000:0.0:1784938023.298643:0:7491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1784938023.298648:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938023.298650:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1784938023.298652:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938023.298653:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1784938023.298673:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938023.298675:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938023.298677:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938023.298678:0:7491:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1784938023.298681:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938023.298683:0:7491:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938023.298719:0:7491:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa05ac7f16000 from lustre-OST0001 10000000:01000000:0.0:1784938023.298758:0:7491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1784938023.298762:0:7491:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784938023.298773:0:7491:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa05ae17299c0 local copy 10000000:01000000:0.0:1784938023.298778:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938023.298834:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.298848:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.298860:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938023.298883:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065464960:0@lo:101: 00000100:00100000:0.0:1784938023.298929:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938023.299000:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.299146:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065464960 00000100:00100000:2.0:1784938023.299155:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065464960 00000100:00100000:2.0:1784938023.299248:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1784938023.299259:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+11:7491:x1871643065464960:12345-0@lo:101: 00010000:00010000:2.0:1784938023.299276:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938023.299295:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893400/0xea86628a8aec35cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec35c5 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.299322:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893400/0xea86628a8aec35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec35c5 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.299334:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893400/0xea86628a8aec35cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35c5 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.299346:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893400, rc 0) 00000100:00100000:2.0:1784938023.299384:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065464960:12345-0@lo:101: Request processed in 127us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.299391:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784938023.299655:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065464960:0@lo:101: 00010000:00010000:0.0:1784938023.299670:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.299682:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938023.299844:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465088:0@lo:501: 00000100:00100000:0.0:1784938023.299878:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938023.299918:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938023.299982:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465088 00000100:00100000:3.0:1784938023.299989:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465088 00000100:00100000:3.0:1784938023.300029:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1784938023.300036:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465088:12345-0@lo:501: 00000100:00100000:3.0:1784938023.300347:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465088:12345-0@lo:501: Request processed in 310us (466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938023.300356:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1784938023.300643:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465088:0@lo:501: 10000000:01000000:0.0:1784938023.300660:0:7491:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1784938023.300696:0:7491:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1784938023.300704:0:7491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.300714:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.300724:0:7491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.300750:0:7491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784938023.300777:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa05ac7f16000 10000000:01000000:0.0:1784938023.300784:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1784938023.300790:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1784938023.300793:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938023.300798:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1784938023.300802:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1784938023.300826:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.300835:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.300846:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938023.300859:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465216:0@lo:101: 00000100:00100000:0.0:1784938023.300902:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938023.300940:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805480 going to sleep for 11 seconds 00010000:00010000:3.0:1784938023.301006:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938023.301014:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.301024:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938023.301037:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.301047:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938023.301056:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938023.301062:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938023.301085:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.301092:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1784938023.301145:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065465344:0@lo:103: 00000100:00100000:0.0:1784938023.301179:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.301248:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465216 00000100:00100000:2.0:1784938023.301255:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465216 00000100:00100000:2.0:1784938023.301293:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1784938023.301310:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465216:12345-0@lo:101: 00010000:00010000:2.0:1784938023.301324:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938023.301339:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec35d3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.301361:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.301372:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.301381:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893200, rc 0) 00000100:00100000:2.0:1784938023.301417:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065465216:12345-0@lo:101: Request processed in 108us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.301423:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938023.301975:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465344 00000100:00100000:1.0:1784938023.301982:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465344 00000100:00100000:1.0:1784938023.302031:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938023.302039:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3323:x1871643065465344:12345-0@lo:103: 00000100:00100000:0.0:1784938023.302042:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465216:0@lo:101: 00010000:00010000:0.0:1784938023.302059:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.302061:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938023.302068:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.302074:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893400/0xea86628a8aec35cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec35c5 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.302088:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938023.302126:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:3323:x1871643065465344:12345-0@lo:103: Request processed in 88us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938023.302132:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938023.302158:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065465344:0@lo:103: 00000100:00100000:0.0:1784938023.302174:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465472:0@lo:501: 00000100:00100000:0.0:1784938023.302206:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.302364:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465472 00000100:00100000:1.0:1784938023.302381:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465472 00000100:00100000:1.0:1784938023.302418:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784938023.302425:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465472:12345-0@lo:501: 00000100:00100000:2.0:1784938023.302626:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938023.302720:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465472:12345-0@lo:501: Request processed in 295us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938023.302728:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784938023.302750:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465472:0@lo:501: 00000100:00100000:2.0:1784938023.302783:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465600:0@lo:503: 00000100:00100000:2.0:1784938023.302831:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.302893:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938023.302932:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465600 00000100:00100000:0.0:1784938023.302936:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465600 00000100:00100000:0.0:1784938023.303003:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1784938023.303012:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465600:12345-0@lo:503: 00010000:00010000:3.0:1784938023.303157:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.303175:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0030600/0xea86628a8aec35c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xea86628a8aec35cc expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938023.303204:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465600:12345-0@lo:503: Request processed in 193us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.303211:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1784938023.303317:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465600:0@lo:503: 00010000:00010000:3.0:1784938023.303328:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938023.303332:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938023.303334:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938023.303819:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938023.303909:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465728:0@lo:502: 00000100:00100000:1.0:1784938023.303965:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.304007:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.304021:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465728 00000100:00100000:2.0:1784938023.304027:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465728 00000100:00100000:2.0:1784938023.304132:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1784938023.304139:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465728:12345-0@lo:502: 00000100:00100000:2.0:1784938023.304757:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465728:12345-0@lo:502: Request processed in 616us (788us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.304766:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784938023.304787:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465728:0@lo:502: 00000040:00080000:1.0:1784938023.305047:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1784938023.305101:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1784938023.305126:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1784938023.305154:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1784938023.305184:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1784938023.305313:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1784938023.305348:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465856:0@lo:502: 00000100:00100000:1.0:1784938023.305388:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.305421:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938023.305432:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465856 00000100:00100000:0.0:1784938023.305439:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465856 00000100:00100000:0.0:1784938023.305615:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1784938023.305689:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465856:12345-0@lo:502: 00000100:00100000:0.0:1784938023.305843:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465856:12345-0@lo:502: Request processed in 219us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.305851:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1784938023.305871:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465856:0@lo:502: 00000040:00080000:1.0:1784938023.305977:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1784938023.305988:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:2.0:1784938023.306691:0:7498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938023.306705:0:7498:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1784938023.306711:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938023.306713:0:7498:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784938023.306718:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938023.306735:0:7498:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa05ad1a23380) 00000020:00000080:2.0:1784938023.306759:0:7498:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784938023.306763:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784938023.306825:0:7498:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05ac7f16000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784938023.306831:0:7498:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938023.306838:0:7498:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea86628a8aec35e8 00010000:00010000:2.0:1784938023.310053:0:7498:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1784938023.310648:0:7498:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1784938023.315376:0:7498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1784938023.315823:0:7498:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1784938023.319995:0:7498:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1784938023.321396:0:7498:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1784938023.322943:0:7498:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1784938023.322962:0:7498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938023.322971:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938023.322974:0:7498:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1784938023.322978:0:7498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938023.322983:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938023.322985:0:7498:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938023.322988:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938023.322991:0:7498:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784938023.323061:0:7498:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938023.323065:0:7498:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938023.323067:0:7498:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1784938023.323070:0:7498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1784938023.323305:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1784938023.323342:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1784938023.323368:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.323391:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938023.323401:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac7f16000 from 1 10000000:01000000:1.0:1784938023.323405:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938023.323473:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.323482:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.323497:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938023.323539:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465984:0@lo:101: 00000100:00100000:1.0:1784938023.323643:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.323693:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.323940:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065465984 00000100:00100000:2.0:1784938023.323951:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065465984 00000100:00100000:2.0:1784938023.324016:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1784938023.324027:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:7491:x1871643065465984:12345-0@lo:101: 00010000:00010000:2.0:1784938023.324054:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938023.324071:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec35ef expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.324101:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec35ef expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.324114:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35ef expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.324125:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938023.324170:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065465984:12345-0@lo:101: Request processed in 145us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.324177:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784938023.324372:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065465984:0@lo:101: 00010000:00010000:1.0:1784938023.324389:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.324400:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938023.324667:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466112:0@lo:501: 00000100:00100000:1.0:1784938023.324702:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.324733:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938023.324798:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466112 00000100:00100000:0.0:1784938023.324805:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466112 00000100:00100000:0.0:1784938023.324841:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784938023.324850:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466112:12345-0@lo:501: 00000100:00100000:0.0:1784938023.325130:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466112:12345-0@lo:501: Request processed in 280us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.325139:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1784938023.325264:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466112:0@lo:501: 00000100:00100000:1.0:1784938023.325298:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466240:0@lo:503: 00000100:00100000:1.0:1784938023.325343:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.325370:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938023.325476:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466240 00000100:00100000:0.0:1784938023.325481:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466240 00000100:00100000:0.0:1784938023.325514:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1784938023.325521:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466240:12345-0@lo:503: 00000100:00100000:0.0:1784938023.325979:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466240:12345-0@lo:503: Request processed in 457us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.325986:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1784938023.326076:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466240:0@lo:503: 00000040:00080000:1.0:1784938023.327655:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938023.327773:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466368:0@lo:502: 00000100:00100000:1.0:1784938023.327862:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.327918:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.328042:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466368 00000100:00100000:2.0:1784938023.328053:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466368 00000100:00100000:2.0:1784938023.328105:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1784938023.328116:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466368:12345-0@lo:502: 00000100:00100000:2.0:1784938023.328436:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466368:12345-0@lo:502: Request processed in 321us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.328445:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1784938023.328642:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466368:0@lo:502: 00000040:00080000:1.0:1784938023.328979:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1784938023.329040:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1784938023.329073:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466496:0@lo:502: 00000100:00100000:1.0:1784938023.329120:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938023.329464:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466496 00000100:00100000:0.0:1784938023.329472:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466496 00000100:00100000:0.0:1784938023.329522:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1784938023.329543:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466496:12345-0@lo:502: 00000100:00100000:0.0:1784938023.329731:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466496:12345-0@lo:502: Request processed in 199us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.329739:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1784938023.330349:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938023.330381:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466496:0@lo:502: 00000040:00080000:1.0:1784938023.333553:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1784938023.333596:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1784938023.337103:0:7502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938023.337124:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938023.337127:0:7502:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938023.337137:0:7502:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05ac7f16000 00000020:00000080:3.0:1784938023.337140:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938023.337632:0:7502:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938023.337639:0:7502:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938023.337641:0:7502:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1784938023.337645:0:7502:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1784938023.340132:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1784938023.340206:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938023.340254:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.340272:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938023.340347:0:7491:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784938023.340350:0:7491:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa05ac7f16000 10000000:01000000:2.0:1784938023.340354:0:7491:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa05ac7f16000 10000000:01000000:2.0:1784938023.340359:0:7491:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938023.340367:0:7491:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac7f16000 from 1 10000000:01000000:2.0:1784938023.340370:0:7491:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938023.340423:0:7491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.340430:0:7491:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.340439:0:7491:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.340478:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466624:0@lo:101: 00000100:00100000:2.0:1784938023.340709:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.340753:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05af4181f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938023.340812:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466624 00000100:00100000:0.0:1784938023.340820:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466624 00000100:00100000:0.0:1784938023.340874:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784938023.345412:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065466624:12345-0@lo:101: 00010000:00010000:0.0:1784938023.345440:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938023.345480:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec35fd expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.345545:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec35fd expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.345556:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35fd expref: 14 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.345565:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030200, rc 0) 00000100:00100000:0.0:1784938023.345674:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065466624:12345-0@lo:101: Request processed in 278us (4963us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.345986:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1784938023.346066:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466624:0@lo:101: 00010000:00010000:0.0:1784938023.346088:0:7491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938023.346100:0:7491:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938023.346744:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466752:0@lo:501: 00000100:00100000:0.0:1784938023.346804:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938023.346889:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.346953:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466752 00000100:00100000:2.0:1784938023.346963:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466752 00000100:00100000:2.0:1784938023.347057:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1784938023.347068:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065466752:12345-0@lo:501: 00000100:00100000:2.0:1784938023.347631:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065466752:12345-0@lo:501: Request processed in 563us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.347641:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1784938023.347808:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466752:0@lo:501: 00000100:00100000:1.0:1784938023.347851:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466880:0@lo:503: 00000100:00100000:1.0:1784938023.347900:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.351780:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.351930:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065466880 00000100:00100000:2.0:1784938023.351942:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065466880 00000100:00100000:2.0:1784938023.352024:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1784938023.352054:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065466880:12345-0@lo:503: 00000100:00100000:2.0:1784938023.352396:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065466880:12345-0@lo:503: Request processed in 344us (4494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.352404:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1784938023.352656:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065466880:0@lo:503: 00000040:00080000:1.0:1784938023.353093:0:7491:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938023.353184:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065467008:0@lo:502: 00000100:00100000:1.0:1784938023.353283:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.353317:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.353387:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467008 00000100:00100000:2.0:1784938023.353392:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467008 00000100:00100000:2.0:1784938023.353431:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1784938023.353439:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065467008:12345-0@lo:502: 00000100:00100000:2.0:1784938023.353734:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065467008:12345-0@lo:502: Request processed in 295us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.353741:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1784938023.353887:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065467008:0@lo:502: 00000040:00080000:1.0:1784938023.354143:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1784938023.354192:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1784938023.354274:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1784938023.354326:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1784938023.354361:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1784938023.354410:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1784938023.354445:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1784938023.354487:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1784938023.354600:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1784938023.354637:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1784938023.354670:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1784938023.354728:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1784938023.354762:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1784938023.354787:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1784938023.354834:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1784938023.354865:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1784938023.354897:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1784938023.354943:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1784938023.354985:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1784938023.355011:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1784938023.355048:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1784938023.355076:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1784938023.355100:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1784938023.355133:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1784938023.355158:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1784938023.355188:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1784938023.355267:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1784938023.355305:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1784938023.355352:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1784938023.355410:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1784938023.355463:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1784938023.355499:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1784938023.356103:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1784938023.356157:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1784938023.356245:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1784938023.356312:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1784938023.356337:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1784938023.356390:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065467136:0@lo:502: 00000100:00100000:1.0:1784938023.356488:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.356603:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938023.356718:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467136 00000100:00100000:2.0:1784938023.356726:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467136 00000100:00100000:2.0:1784938023.356769:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1784938023.356777:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065467136:12345-0@lo:502: 00000100:00100000:2.0:1784938023.357022:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065467136:12345-0@lo:502: Request processed in 245us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938023.357028:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1784938023.357132:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065467136:0@lo:502: 00000040:00080000:1.0:1784938023.357206:0:7491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1784938023.357252:0:7491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1784938023.357932:0:7503:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1784938023.357950:0:7503:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa05ac6b20000) 00000020:00000080:0.0:1784938023.357979:0:7503:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1784938023.358177:0:7503:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05ac7f16000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784938023.358183:0:7503:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05ac7f16000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1784938023.358186:0:7503:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac7f16000 3 00010000:00080000:0.0:1784938023.358257:0:7503:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05b01e05000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.158@tcp at head 00010000:00010000:2.0:1784938023.364981:0:7503:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1784938023.365107:0:7503:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1784938023.365156:0:7503:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1784938023.365176:0:7503:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xea86628a8aec3612 00000100:00080000:2.0:1784938023.365195:0:7503:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:2.0:1784938023.365211:0:7503:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa05b01e05000 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:2.0:1784938023.366801:0:7503:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05afbeac700 x1871643065467264/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938023.366888:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1871643065467264:192.168.201.158@tcp:38: 00000100:00080000:2.0:1784938023.367113:0:7503:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784938023.367708:0:7505:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffffa05afbeaf800 x1871643065467392/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938023.367722:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1bd6840 going to sleep for 0 seconds 00000040:00080000:3.0:1784938023.367874:0:7503:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1784938023.368085:0:7491:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1784938023.368119:0:7491:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938023.368151:0:7491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938023.368165:0:7491:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784938023.368273:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784938023.368277:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938023.368278:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938023.368279:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938023.368281:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938023.368282:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938023.368284:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938023.368286:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938023.368288:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938023.368290:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938023.368292:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784938023.368298:0:7491:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:2.0:1784938023.368301:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784938023.368302:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938023.368303:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938023.368305:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938023.368306:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938023.368307:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938023.368308:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938023.368309:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938023.368310:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938023.368311:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938023.368312:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784938023.368333:0:7491:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784938023.368346:0:7491:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065467520:0@lo:253: 00000100:00100000:2.0:1784938023.368477:0:7491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938023.368522:0:7491:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1bd6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938023.368722:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467520 00000100:00100000:1.0:1784938023.368732:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467520 00000100:00100000:1.0:1784938023.368791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1784938023.368802:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7491:x1871643065467520:12345-0@lo:253: 20000000:01000000:1.0:1784938023.368842:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1784938023.368860:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784938023.375063:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938023.375241:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467264 00000100:00100000:0.0:1784938023.375252:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467264 00000100:00100000:0.0:1784938023.375308:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938023.375320:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3320:x1871643065467264:12345-192.168.201.158@tcp:38: 00010000:00080000:0.0:1784938023.375361:0:5805:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 232 last 0 00000020:00000080:0.0:1784938023.375410:0:5805:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xea86628a8aec3619 00000004:00100000:0.0:1784938023.375431:0:5805:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784938023.375497:0:5805:0:(import.c:65:import_set_state_nolock()) ffffa05b01e06800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938023.375596:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871643065467264:12345-192.168.201.158@tcp:38: Request processed in 276us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.375605:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00010000:00080000:0.0:1784938023.375754:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeac700 x1871643065467264/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938023.375769:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938023.375779:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1784938023.375789:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1784938023.375795:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1784938023.375798:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05b01e05000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1784938023.375807:0:3320:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000089f1780d): req@ffffa05afbeaf800 x1871643065467392/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938023.375827:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1871643065467264:192.168.201.158@tcp:38: 00000100:00100000:0.0:1784938023.375993:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938023.376017:0:7505:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1bd6840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938023.376249:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065467648:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938023.377115:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938023.377148:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467648 00000100:00100000:0.0:1784938023.377157:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467648 00000100:00100000:0.0:1784938023.377205:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:0.0:1784938023.377242:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065467648:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938023.377301:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065467648:12345-192.168.201.158@tcp:400: Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.377309:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 9 00010000:00080000:1.0:1784938023.377928:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb3b80 x1871643065467648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938023.377946:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065467648:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938023.378045:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065467776:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938023.378116:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938023.378125:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065467904:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938023.379659:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938023.379701:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938023.379774:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467904 00000100:00100000:1.0:1784938023.379783:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467904 00000100:00100000:1.0:1784938023.379851:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938023.379862:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065467904:12345-192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938023.379931:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065467904:12345-192.168.201.158@tcp:400: Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938023.379939:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00080000:1.0:1784938023.379964:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938023.380081:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb1880 x1871643065467904/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938023.380096:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065467904:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938023.380165:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467776 00000100:00100000:0.0:1784938023.380170:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467776 00000100:00100000:0.0:1784938023.380240:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00100000:0.0:1784938023.380249:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065467776:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938023.380285:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065467776:12345-192.168.201.158@tcp:400: Request processed in 38us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938023.380292:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00080000:1.0:1784938023.380500:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938023.382401:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065467392 00000100:00100000:3.0:1784938023.382419:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065467392 00000100:00100000:3.0:1784938023.382512:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:3.0:1784938023.382523:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7505:x1871643065467392:12345-192.168.201.158@tcp:901: 00000100:00100000:3.0:1784938023.387367:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7505:x1871643065467392:12345-192.168.201.158@tcp:901: Request processed in 4824us (11353us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.387386:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00080000:3.0:1784938023.387483:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938023.391008:0:7505:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeaf800 x1871643065467392/t0(0) o901->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:29/10 lens 248/4320 e 0 to 0 dl 1784938039 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938023.391034:0:7505:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf800 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7505:1871643065467392:192.168.201.158@tcp:901: 00010000:00080000:0.0:1784938023.391287:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb0380 x1871643065467776/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938023.391298:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065467776:192.168.201.158@tcp:400: 20000000:01000000:1.0:1784938023.397747:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938023.397772:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1784938023.397832:0:5820:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938023.397839:0:5820:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938023.397871:0:5820:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.397894:0:5820:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec356a expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.397904:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.397963:0:5820:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec356a expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.397982:0:5820:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec356a expref: 14 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938023.398002:0:5820:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1871643065468032:0@lo:104: 00000100:00100000:3.0:1784938023.398093:0:5820:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938023.398152:0:5820:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55b40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938023.400862:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468032 00000100:00100000:1.0:1784938023.400886:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468032 00000100:00100000:1.0:1784938023.400961:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938023.400972:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5820:x1871643065468032:12345-0@lo:104: 00010000:00010000:1.0:1784938023.400999:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401384:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938023.401392:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:5820:x1871643065468032:12345-0@lo:104: Request processed in 422us (3298us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938023.401401:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:1.0:1784938023.401429:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938023.401437:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401486:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938023.401490:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401501:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938023.401509:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938023.401515:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938023.401575:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401582:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938023.401615:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401622:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0031400/0xea86628a8aec356a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3571 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401644:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938023.401647:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938023.401649:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938023.401659:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938023.401678:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065468160:0@lo:103: 00000100:00100000:1.0:1784938023.401736:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938023.401791:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468160 00000100:00100000:1.0:1784938023.401797:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468160 00010000:00010000:1.0:1784938023.401829:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec356a expref: 15 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938023.401856:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938023.401863:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:3324:x1871643065468160:12345-0@lo:103: 00010000:00010000:1.0:1784938023.401876:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938023.401882:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec356a expref: 15 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401893:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec356a expref: 15 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401917:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401926:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1784938023.401943:0:5790:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004392170s 00010000:00010000:1.0:1784938023.401949:0:5790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401956:0:5790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401962:0:5790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401968:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401973:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11bc00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938023.401984:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.401991:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.402000:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938023.402009:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938023.402043:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea0c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:3324:x1871643065468160:12345-0@lo:103: Request processed in 181us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938023.402049:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938023.402135:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065468160:0@lo:103: 00010000:00010000:3.0:1784938023.402665:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11a200/0xea86628a8aec3571 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec356a expref: 14 pid: 5797 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938023.402693:0:5820:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5820:1871643065468032:0@lo:104: 00010000:00010000:3.0:1784938023.402710:0:5820:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.402721:0:5820:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.402727:0:5820:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938023.402733:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3620 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5820 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938023.406355:0:7491:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7491:1871643065467520:0@lo:253: 10000000:01000000:2.0:1784938023.406378:0:7491:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784938023.406383:0:7491:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938023.406385:0:7491:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938023.406386:0:7491:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938023.406387:0:7491:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938023.406389:0:7491:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938023.406390:0:7491:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938023.406392:0:7491:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938023.406393:0:7491:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1784938023.406395:0:7491:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1784938023.406397:0:7491:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938023.406399:0:7491:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938023.406423:0:7491:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1784938023.406636:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:7491:x1871643065467520:12345-0@lo:253: Request processed in 37399us (37722us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.406653:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00080000:10000000:2.0:1784938023.411610:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938023.411781:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938023.411967:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938023.412167:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938023.412657:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938023.412865:0:7491:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784938023.413826:0:7491:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1784938023.479994:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938023.480035:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065468288:192.168.201.158@tcp:13: 00000100:00100000:3.0:1784938023.480527:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938023.480570:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468288 00000100:00100000:3.0:1784938023.480581:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468288 00000100:00100000:3.0:1784938023.480644:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:3.0:1784938023.480655:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065468288:12345-192.168.201.158@tcp:13: 00002000:00000024:3.0:1784938023.480702:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784938023.480756:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065468288:12345-192.168.201.158@tcp:13: Request processed in 102us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938023.480764:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00010000:00080000:3.0:1784938023.480919:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05afbeb0380 x1871643065468288/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938039 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938023.480959:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065468288:192.168.201.158@tcp:13: 00002000:00080000:1.0:1784938023.588622:0:7491:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1784938023.588630:0:7491:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1784938023.588664:0:7491:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1784938023.588731:0:7491:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1784938023.588752:0:7491:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1784938023.588789:0:7491:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1784938023.794804:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938024.820855:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938025.841439:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938026.867903:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938027.892762:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938028.597202:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938028.597266:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065468416:192.168.201.158@tcp:13: 00000100:00100000:0.0:1784938028.597610:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938028.597644:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468416 00000100:00100000:0.0:1784938028.597652:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468416 00000100:00100000:0.0:1784938028.597706:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:0.0:1784938028.597714:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065468416:12345-192.168.201.158@tcp:13: 00002000:00000024:0.0:1784938028.597755:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:0.0:1784938028.597792:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065468416:12345-192.168.201.158@tcp:13: Request processed in 79us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938028.597797:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00080000:0.0:1784938028.597816:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938028.597925:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb3800 x1871643065468416/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938044 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938028.597943:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065468416:192.168.201.158@tcp:13: 00000100:00100000:1.0:1784938028.602557:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065468672:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938028.602680:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065468800:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938028.604617:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065468928:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938028.604741:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938028.604750:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065468544:0@lo:400: 00000100:00100000:3.0:1784938028.604804:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938028.605462:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938028.605521:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938028.605542:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938028.605571:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468544 00000100:00100000:0.0:1784938028.605580:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468544 00000100:00100000:0.0:1784938028.605635:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784938028.605644:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065468544:12345-0@lo:400: 00000100:00100000:0.0:1784938028.605723:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065468544:12345-0@lo:400: Request processed in 78us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938028.605731:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1784938028.605774:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468800 00000100:00100000:0.0:1784938028.605777:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468800 00000100:00100000:0.0:1784938028.605810:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468672 00000100:00100000:0.0:1784938028.605813:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468672 00000100:00100000:0.0:1784938028.605823:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065468928 00000100:00100000:0.0:1784938028.605825:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065468928 00000100:00100000:0.0:1784938028.605838:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:0.0:1784938028.605844:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065468800:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938028.605884:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065468800:12345-192.168.201.158@tcp:400: Request processed in 39us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938028.605889:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:0.0:1784938028.605901:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:0.0:1784938028.605906:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065468672:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938028.605925:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065468672:12345-192.168.201.158@tcp:400: Request processed in 20us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938028.605931:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:0.0:1784938028.605939:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:0.0:1784938028.605944:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065468928:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938028.605962:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065468928:12345-192.168.201.158@tcp:400: Request processed in 19us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938028.605968:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:0.0:1784938028.606018:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065468544:0@lo:400: 00000100:00080000:0.0:1784938028.606053:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938028.606201:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac83e6d80 x1871643065468800/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938028.606242:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065468800:192.168.201.158@tcp:400: 00010000:00080000:0.0:1784938028.606275:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac83e6a00 x1871643065468672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938028.606285:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065468672:192.168.201.158@tcp:400: 00010000:00080000:0.0:1784938028.606307:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac83e7100 x1871643065468928/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938044 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938028.606317:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065468928:192.168.201.158@tcp:400: 00010000:00010000:0.0:1784938028.913417:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938029.939538:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938030.652697:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784938030.652709:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac73fb000 from 30 10000000:01000000:3.0:1784938030.652717:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938030.652785:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.652798:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.652812:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938030.652842:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469056:0@lo:101: 00000100:00100000:3.0:1784938030.652938:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.653355:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938030.654392:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469056 00000100:00100000:2.0:1784938030.654408:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469056 00000100:00100000:2.0:1784938030.654528:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1784938030.654540:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065469056:12345-0@lo:101: 00010000:00010000:2.0:1784938030.654561:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938030.654583:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3627 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938030.654639:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3627 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938030.654652:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3627 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938030.654663:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938030.654742:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065469056:12345-0@lo:101: Request processed in 204us (1803us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938030.654749:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1784938030.655075:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469056:0@lo:101: 00010000:00010000:3.0:1784938030.655097:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.655109:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938030.655203:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469184:0@lo:501: 00000100:00100000:3.0:1784938030.655290:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.661862:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.662117:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469184 00000100:00100000:1.0:1784938030.662130:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469184 00000100:00100000:1.0:1784938030.662194:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1784938030.662203:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065469184:12345-0@lo:501: 00000100:00100000:1.0:1784938030.662614:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065469184:12345-0@lo:501: Request processed in 410us (7323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.662622:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1784938030.663179:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469184:0@lo:501: 00000100:00100000:3.0:1784938030.663265:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469312:0@lo:503: 00000100:00100000:3.0:1784938030.663318:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.663364:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.663381:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469312 00000100:00100000:3.0:1784938030.663385:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469312 00000100:00100000:3.0:1784938030.663409:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784938030.663416:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065469312:12345-0@lo:503: 00000100:00100000:3.0:1784938030.663578:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065469312:12345-0@lo:503: Request processed in 161us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.663584:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1784938030.663618:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469312:0@lo:503: 00000100:00100000:3.0:1784938030.663814:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7834:1871643065469440:0@lo:502: 00000100:00100000:3.0:1784938030.663844:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.663859:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469440 00000100:00100000:3.0:1784938030.663862:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469440 00000100:00100000:3.0:1784938030.663876:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784938030.663881:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7834:x1871643065469440:12345-0@lo:502: 00000100:00100000:3.0:1784938030.664154:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7834:x1871643065469440:12345-0@lo:502: Request processed in 272us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.664161:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1784938030.664191:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2da480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.664201:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7834:1871643065469440:0@lo:502: 00000100:00100000:3.0:1784938030.664260:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7834:1871643065469568:0@lo:502: 00000100:00100000:3.0:1784938030.664289:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.664305:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469568 00000100:00100000:3.0:1784938030.664308:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469568 00000100:00100000:3.0:1784938030.664322:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784938030.664339:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7834:x1871643065469568:12345-0@lo:502: 00000100:00100000:3.0:1784938030.664460:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:7834:x1871643065469568:12345-0@lo:502: Request processed in 120us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.664466:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1784938030.664495:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2da480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.664506:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7834:1871643065469568:0@lo:502: 00000040:00080000:3.0:1784938030.664524:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1784938030.664600:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1784938030.664622:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938030.664635:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.664646:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938030.664656:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784938030.664659:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1784938030.664662:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938030.664692:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.664709:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.664719:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938030.664730:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469696:0@lo:101: 00000100:00100000:3.0:1784938030.664759:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.664772:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2da480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.664785:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469696 00000100:00100000:3.0:1784938030.664788:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469696 00000100:00100000:3.0:1784938030.664805:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784938030.664811:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065469696:12345-0@lo:101: 00010000:00010000:3.0:1784938030.664820:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938030.664836:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3635 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.664861:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3635 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.664872:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3635 expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.664883:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11aa00, rc 0) 00000100:00100000:3.0:1784938030.664911:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065469696:12345-0@lo:101: Request processed in 100us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.664917:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1784938030.664961:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469696:0@lo:101: 00010000:00010000:3.0:1784938030.666194:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.666207:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938030.666287:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469824:0@lo:501: 00000100:00100000:3.0:1784938030.666355:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.666383:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2da480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.666415:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469824 00000100:00100000:3.0:1784938030.666422:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469824 00000100:00100000:3.0:1784938030.666454:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784938030.666461:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065469824:12345-0@lo:501: 00000100:00100000:3.0:1784938030.666764:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065469824:12345-0@lo:501: Request processed in 302us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.666773:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1784938030.666816:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469824:0@lo:501: 00000100:00100000:3.0:1784938030.666842:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469952:0@lo:503: 00000100:00100000:3.0:1784938030.666878:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.666891:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2da480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.666902:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065469952 00000100:00100000:3.0:1784938030.666905:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065469952 00000100:00100000:3.0:1784938030.666921:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784938030.666926:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065469952:12345-0@lo:503: 00000100:00100000:3.0:1784938030.670953:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065469952:12345-0@lo:503: Request processed in 4008us (4056us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.673285:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1784938030.673438:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065469952:0@lo:503: 00000100:00100000:3.0:1784938030.676319:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7835:1871643065470080:0@lo:502: 00000100:00100000:3.0:1784938030.676450:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.676509:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2da480 going to sleep for 11 seconds 00000100:00100000:2.0:1784938030.676676:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470080 00000100:00100000:2.0:1784938030.676687:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470080 00000100:00100000:2.0:1784938030.676787:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1784938030.676799:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:7835:x1871643065470080:12345-0@lo:502: 00000100:00100000:2.0:1784938030.677619:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:7835:x1871643065470080:12345-0@lo:502: Request processed in 820us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938030.677631:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1784938030.677753:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7835:1871643065470080:0@lo:502: 00000020:01000000:3.0:1784938030.677789:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938030.677801:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938030.677804:0:7835:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:3.0:1784938030.677810:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1784938030.677813:0:7835:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1784938030.677837:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7835:1871643065470208:0@lo:502: 00000100:00100000:3.0:1784938030.677878:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.682476:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470208 00000100:00100000:1.0:1784938030.682495:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470208 00000100:00100000:0.0:1784938030.682733:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1784938030.682745:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:7835:x1871643065470208:12345-0@lo:502: 00000100:00100000:0.0:1784938030.683187:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:7835:x1871643065470208:12345-0@lo:502: Request processed in 443us (5308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.683197:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1784938030.684211:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8b429c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.685188:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7835:1871643065470208:0@lo:502: 00000020:01000000:3.0:1784938030.685268:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938030.685280:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938030.685282:0:7835:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:3.0:1784938030.685288:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1784938030.685552:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1784938030.685579:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1784938030.685595:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.685609:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938030.685621:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784938030.685633:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac735f800 from 30 10000000:01000000:0.0:1784938030.685636:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938030.685685:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.685695:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.685707:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938030.685737:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470336:0@lo:101: 00000100:00100000:0.0:1784938030.685821:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938030.685880:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae00f4780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.686069:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470336 00000100:00100000:1.0:1784938030.686078:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470336 00000100:00100000:1.0:1784938030.686139:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784938030.686149:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065470336:12345-0@lo:101: 00010000:00010000:1.0:1784938030.686166:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938030.686182:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3643 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.686251:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3643 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.686265:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3643 expref: 16 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.686275:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990200, rc 0) 00000100:00100000:1.0:1784938030.686334:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065470336:12345-0@lo:101: Request processed in 177us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.686341:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1784938030.686380:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470336:0@lo:101: 00010000:00010000:1.0:1784938030.686396:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.686406:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.686478:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470464:0@lo:501: 00000100:00100000:1.0:1784938030.686507:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.686529:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.686543:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470464 00000100:00100000:1.0:1784938030.686547:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470464 00000100:00100000:1.0:1784938030.686565:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784938030.686572:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065470464:12345-0@lo:501: 00000100:00100000:1.0:1784938030.686877:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065470464:12345-0@lo:501: Request processed in 304us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.686886:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1784938030.686917:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470464:0@lo:501: 00000100:00100000:1.0:1784938030.686946:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470592:0@lo:503: 00000100:00100000:1.0:1784938030.688151:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.688196:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.688249:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470592 00000100:00100000:1.0:1784938030.688256:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470592 00000100:00100000:1.0:1784938030.688295:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784938030.688303:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065470592:12345-0@lo:503: 00000100:00100000:1.0:1784938030.688546:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065470592:12345-0@lo:503: Request processed in 242us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.688554:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1784938030.688604:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470592:0@lo:503: 00000100:00100000:3.0:1784938030.691358:0:7836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7836:1871643065470720:0@lo:502: 00000100:00100000:3.0:1784938030.691469:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.691526:0:7836:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dac00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.691599:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470720 00000100:00100000:1.0:1784938030.691609:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470720 00000100:00100000:1.0:1784938030.691681:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1784938030.691691:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:7836:x1871643065470720:12345-0@lo:502: 00000100:00100000:1.0:1784938030.692016:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:7836:x1871643065470720:12345-0@lo:502: Request processed in 326us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.692025:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1784938030.692282:0:7836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7836:1871643065470720:0@lo:502: 00000100:00100000:3.0:1784938030.692354:0:7836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7836:1871643065470848:0@lo:502: 00000100:00100000:3.0:1784938030.692393:0:7836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938030.692414:0:7836:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8b429c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.693342:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470848 00000100:00100000:1.0:1784938030.693351:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470848 00000100:00100000:1.0:1784938030.693406:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1784938030.693416:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:7836:x1871643065470848:12345-0@lo:502: 00000100:00100000:1.0:1784938030.693685:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:7836:x1871643065470848:12345-0@lo:502: Request processed in 270us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.693693:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1784938030.693802:0:7836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7836:1871643065470848:0@lo:502: 00000040:00080000:3.0:1784938030.693841:0:7836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1784938030.695121:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1784938030.695157:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1784938030.695171:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.695186:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938030.695197:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1784938030.695200:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05ac735f800 from 5 10000000:01000000:1.0:1784938030.695204:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938030.695273:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.695282:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.695307:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.695343:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470976:0@lo:101: 00000100:00100000:1.0:1784938030.695414:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.695467:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.695564:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065470976 00000100:00100000:3.0:1784938030.695574:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065470976 00000100:00100000:3.0:1784938030.695626:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1784938030.695635:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065470976:12345-0@lo:101: 00010000:00010000:3.0:1784938030.695651:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938030.695668:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11b200/0xea86628a8aec3658 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3651 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.695695:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11b200/0xea86628a8aec3658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3651 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.695707:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11b200/0xea86628a8aec3658 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3651 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938030.695717:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b200, rc 0) 00000100:00100000:3.0:1784938030.695756:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065470976:12345-0@lo:101: Request processed in 122us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.695763:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1784938030.696199:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065470976:0@lo:101: 00010000:00010000:1.0:1784938030.696296:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.696307:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.696372:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471104:0@lo:256: 00000100:00100000:1.0:1784938030.696414:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.696482:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938030.700172:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471104 00000100:00100000:3.0:1784938030.700191:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471104 00000100:00100000:3.0:1784938030.701101:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1784938030.701118:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065471104:12345-0@lo:256: 20000000:01000000:3.0:1784938030.701154:0:5799:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938030.701175:0:5799:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938030.701179:0:5799:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1784938030.701389:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065471104:12345-0@lo:256: Request processed in 275us (4973us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.701398:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1784938030.701528:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471104:0@lo:256: 10000000:01000000:1.0:1784938030.701596:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1784938030.701608:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.701620:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938030.701631:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1784938030.701634:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1784938030.701642:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1784938030.701678:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.701688:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.701699:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.701720:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471232:0@lo:101: 00000100:00100000:1.0:1784938030.701757:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.705626:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938030.705818:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471232 00000100:00100000:0.0:1784938030.705831:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471232 00000100:00100000:0.0:1784938030.705900:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1784938030.705911:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065471232:12345-0@lo:101: 00010000:00010000:0.0:1784938030.705934:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938030.706076:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec365f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.706120:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec365f expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.706135:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec365f expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.706147:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938030.706255:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065471232:12345-0@lo:101: Request processed in 346us (4497us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.706278:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784938030.707357:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471232:0@lo:101: 00010000:00010000:1.0:1784938030.707387:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.707401:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.707505:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471360:0@lo:501: 00000100:00100000:1.0:1784938030.707565:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.707612:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.707637:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471360 00000100:00100000:1.0:1784938030.707641:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471360 00000100:00100000:1.0:1784938030.707675:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1784938030.707684:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065471360:12345-0@lo:501: 00000100:00100000:1.0:1784938030.708829:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065471360:12345-0@lo:501: Request processed in 1139us (1257us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.708850:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1784938030.708956:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471360:0@lo:501: 00000100:00100000:2.0:1784938030.709116:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471488:0@lo:503: 00000100:00100000:2.0:1784938030.711453:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938030.711511:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.712132:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471488 00000100:00100000:1.0:1784938030.712145:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471488 00000100:00100000:1.0:1784938030.712247:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784938030.712261:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065471488:12345-0@lo:503: 00000100:00100000:1.0:1784938030.712680:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065471488:12345-0@lo:503: Request processed in 421us (1236us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.712691:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1784938030.712857:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065471488:0@lo:503: 00000100:00100000:0.0:1784938030.717459:0:7837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7837:1871643065471616:0@lo:502: 00000100:00100000:0.0:1784938030.717588:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938030.717650:0:7837:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae00f4600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.717898:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471616 00000100:00100000:1.0:1784938030.717907:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471616 00000100:00100000:1.0:1784938030.718111:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1784938030.718123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:7837:x1871643065471616:12345-0@lo:502: 00000100:00100000:1.0:1784938030.718599:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:7837:x1871643065471616:12345-0@lo:502: Request processed in 477us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938030.718608:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1784938030.718725:0:7837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7837:1871643065471616:0@lo:502: 00000020:01000000:0.0:1784938030.718763:0:7837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938030.718772:0:7837:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784938030.718781:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938030.718784:0:7837:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1784938030.718791:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938030.718796:0:7837:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:0.0:1784938030.718825:0:7837:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784938030.718828:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938030.718848:0:7837:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa05ac6b23380) 00000020:00000080:0.0:1784938030.718879:0:7837:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1784938030.718885:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938030.719001:0:7837:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1784938030.719009:0:7837:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:0.0:1784938030.719017:0:7837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec3674 00010000:00080000:0.0:1784938030.719056:0:7837:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa059c34f6800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1784938030.719344:0:7837:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1784938030.719737:0:7837:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1784938030.719751:0:7837:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784938030.720375:0:7837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938030.720594:0:7837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938030.720651:0:7837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1784938030.720715:0:7837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1784938030.725776:0:7840:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938030.725789:0:7840:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1784938030.737620:0:7837:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1784938030.737646:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1784938030.737694:0:7837:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1784938030.737724:0:7837:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec367b 00000100:00080000:0.0:1784938030.737740:0:7837:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:0.0:1784938030.737755:0:7837:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa059c34f6800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:0.0:1784938030.737804:0:7837:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05afbeb1f80 x1871643065471744/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1784938030.737837:0:7837:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1784938030.737907:0:7837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938030.737912:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938030.737914:0:7837:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1784938030.737916:0:7837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938030.737920:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938030.737922:0:7837:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938030.737924:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938030.737926:0:7837:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1784938030.737962:0:7837:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7837:1871643065471872:0@lo:502: 00000100:00100000:1.0:1784938030.738111:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065471744:192.168.201.158@tcp:8: 00000100:00100000:0.0:1784938030.739200:0:7837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938030.739283:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471872 00000100:00100000:2.0:1784938030.739293:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471872 00000100:00100000:2.0:1784938030.739363:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784938030.739375:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:7837:x1871643065471872:12345-0@lo:502: 00000100:00100000:0.0:1784938030.739394:0:7837:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae00f4300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938030.739715:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:7837:x1871643065471872:12345-0@lo:502: Request processed in 341us (520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938030.739729:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1784938030.739754:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938030.739784:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065472000:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938030.739841:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938030.739846:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065471744 00000100:00100000:0.0:1784938030.739848:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065472384:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938030.739851:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065471744 00000100:00100000:3.0:1784938030.739886:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:0.0:1784938030.739886:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065472128:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938030.739892:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065471744:12345-192.168.201.158@tcp:8: 00000100:00100000:0.0:1784938030.739911:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938030.739916:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065472256:192.168.201.158@tcp:400: 00010000:00080000:3.0:1784938030.739924:0:6602:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 239 last 0 00000020:00000080:3.0:1784938030.740098:0:6602:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec3682 00002000:00100000:3.0:1784938030.740114:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa05aee04e800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1784938030.740119:0:6602:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1784938030.740124:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1784938030.740336:0:6602:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1784938030.740542:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1784938030.740579:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa05aee04b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938030.740619:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1871643065471744:12345-192.168.201.158@tcp:8: Request processed in 726us (866us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.740627:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:1.0:1784938030.743178:0:7837:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:7837:1871643065471872:0@lo:502: 00000020:01000000:0.0:1784938030.743398:0:7837:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938030.743470:0:7837:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938030.743474:0:7837:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1784938030.743479:0:7837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1784938030.744089:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1784938030.744121:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938030.744134:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.744149:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938030.744164:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1784938030.744182:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa05ae17299c0 from 1 10000000:01000000:1.0:1784938030.744187:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1784938030.744255:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.744265:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.744275:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.744301:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065472512:0@lo:101: 00000100:00100000:1.0:1784938030.744414:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.744472:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938030.744491:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472512 00000100:00100000:0.0:1784938030.744501:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472512 00000100:00100000:0.0:1784938030.744574:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784938030.744585:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065472512:12345-0@lo:101: 00000100:00100000:2.0:1784938030.744594:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00010000:00010000:0.0:1784938030.744603:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:2.0:1784938030.744620:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00010000:00010000:0.0:1784938030.744621:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3689 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938030.744637:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00010000:00010000:0.0:1784938030.744654:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3689 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938030.744666:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00010000:00010000:0.0:1784938030.744666:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3689 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938030.744676:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031800, rc 0) 00000100:00100000:0.0:1784938030.744719:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065472512:12345-0@lo:101: Request processed in 135us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.744725:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1784938030.744767:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472000 00000100:00100000:0.0:1784938030.744771:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472000 00000100:00100000:0.0:1784938030.744799:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472384 00000100:00100000:0.0:1784938030.744801:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472384 00000100:00100000:0.0:1784938030.744822:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472128 00000100:00100000:0.0:1784938030.744824:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472128 00000100:00100000:0.0:1784938030.744839:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:0.0:1784938030.744844:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065472000:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938030.744909:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065472000:12345-192.168.201.158@tcp:400: Request processed in 63us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.744916:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:0.0:1784938030.744929:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00100000:0.0:1784938030.744935:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065472384:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938030.744958:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065472384:12345-192.168.201.158@tcp:400: Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.744964:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00100000:0.0:1784938030.744977:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00100000:0.0:1784938030.744982:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065472128:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938030.745008:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065472128:12345-192.168.201.158@tcp:400: Request processed in 26us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.745014:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00100000:1.0:1784938030.745111:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065472512:0@lo:101: 00010000:00010000:1.0:1784938030.745128:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.745138:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938030.745196:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065472640:0@lo:501: 00000100:00100000:1.0:1784938030.745247:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938030.745270:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938030.745286:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472640 00000100:00100000:1.0:1784938030.745290:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472640 00000100:00100000:1.0:1784938030.745314:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784938030.745320:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065472640:12345-0@lo:501: 00000100:00100000:1.0:1784938030.745639:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065472640:12345-0@lo:501: Request processed in 318us (391us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938030.745653:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784938030.745692:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065472640:0@lo:501: 10000000:01000000:1.0:1784938030.745729:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1784938030.745735:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938030.745743:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784938030.746261:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938030.746688:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2826680 x1871643065472384/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.746704:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065472384:192.168.201.158@tcp:400: 00010000:00080000:0.0:1784938030.746718:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb3480 x1871643065472000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.746727:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065472000:192.168.201.158@tcp:400: 00010000:00080000:0.0:1784938030.746869:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb1f80 x1871643065471744/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.746878:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938030.746895:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1784938030.746904:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938030.746910:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784938030.746914:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa059c34f6800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938030.746929:0:3320:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938030.746936:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065471744:192.168.201.158@tcp:8: 00010000:00080000:0.0:1784938030.746966:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb0700 x1871643065472128/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.746976:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065472128:192.168.201.158@tcp:400: 00000004:00080000:3.0:1784938030.747283:0:7840:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1784938030.747454:0:7840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 239690237988ns, next at 0ns, rc = 0 00000100:00100000:3.0:1784938030.749464:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472256 00000100:00100000:3.0:1784938030.749484:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472256 00000100:00100000:3.0:1784938030.749576:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:3.0:1784938030.749588:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065472256:12345-192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938030.749706:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065472256:12345-192.168.201.158@tcp:400: Request processed in 119us (5037us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938030.749714:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00080000:0.0:1784938030.749796:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938030.753867:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb3b80 x1871643065472256/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.753896:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065472256:192.168.201.158@tcp:400: 00000001:02000400:1.0:1784938030.821958:0:7854:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:3.0:1784938030.857478:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:0.0:1784938030.935871:0:7842:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1784938030.935924:0:7842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065472896:192.168.201.158@tcp:7: 00000100:00100000:0.0:1784938030.936071:0:7842:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae00f4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938030.936160:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938030.936179:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065472768:192.168.201.158@tcp:13: 00000100:00100000:1.0:1784938030.936785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938030.936878:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938030.936909:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472896 00000100:00100000:1.0:1784938030.936918:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472896 00000100:00100000:1.0:1784938030.937806:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:1.0:1784938030.937823:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7842:x1871643065472896:12345-192.168.201.158@tcp:7: 00000100:00080000:2.0:1784938030.941338:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938030.941382:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065472768 00000100:00100000:2.0:1784938030.941397:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065472768 00000100:00100000:2.0:1784938030.941558:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:2.0:1784938030.941571:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065472768:12345-192.168.201.158@tcp:13: 00002000:00000024:2.0:1784938030.941624:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1784938030.941727:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065472768:12345-192.168.201.158@tcp:13: Request processed in 158us (4846us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938030.941736:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00010000:00080000:0.0:1784938030.959679:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2826680 x1871643065472768/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.959718:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065472768:192.168.201.158@tcp:13: 00010000:00010000:0.0:1784938030.964163:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1784938030.975208:0:6605:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:0.0:1784938030.975240:0:6605:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784938030.975373:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7842:x1871643065472896:12345-192.168.201.158@tcp:7: Request processed in 37546us (38580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938030.975387:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00010000:00080000:0.0:1784938030.976262:0:7842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824e00 x1871643065472896/t0(0) o7->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 264/240 e 0 to 0 dl 1784938046 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938030.976284:0:7842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065472896:192.168.201.158@tcp:7: 00000004:00080000:0.0:1784938030.976306:0:7842:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1784938030.976381:0:7842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065473024:192.168.201.158@tcp:5: 00000100:00100000:0.0:1784938030.976485:0:7842:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae00f4f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938030.976775:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938030.976810:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473024 00000100:00100000:0.0:1784938030.976819:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473024 00000100:00100000:0.0:1784938030.976882:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:0.0:1784938030.976892:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7842:x1871643065473024:12345-192.168.201.158@tcp:5: 00002000:00080000:0.0:1784938030.976931:0:6602:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1784938030.976936:0:6602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1784938030.977466:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7842:x1871643065473024:12345-192.168.201.158@tcp:5: Request processed in 569us (858us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784938030.977476:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00010000:00080000:2.0:1784938030.978169:0:7842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824e00 x1871643065473024/t0(0) o5->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938046 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938030.978193:0:7842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065473024:192.168.201.158@tcp:5: 00000004:00080000:2.0:1784938030.978210:0:7842:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1784938030.978280:0:7842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeaf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065473152:192.168.201.158@tcp:700: 00000100:00100000:2.0:1784938030.978351:0:7842:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05af52d4000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938030.978725:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938030.979211:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473152 00000100:00100000:2.0:1784938030.979249:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473152 00000100:00100000:2.0:1784938030.979329:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784938030.979340:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7842:x1871643065473152:12345-192.168.201.158@tcp:700: 00000100:00100000:2.0:1784938030.980549:0:6611:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeac700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6611:1871643065473280:192.168.201.158@tcp:700: 00000100:00100000:2.0:1784938030.980652:0:6611:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05af52d4600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938030.982456:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938030.983413:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473280 00000100:00100000:1.0:1784938030.983428:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473280 00000100:00100000:1.0:1784938030.983503:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:1.0:1784938030.983517:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6611:x1871643065473280:12345-192.168.201.158@tcp:700: 40000000:02000000:0.0:1784938031.052355:0:5811:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1784938031.062811:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6611:x1871643065473280:12345-192.168.201.158@tcp:700: Request processed in 79280us (80349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938031.062838:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:2.0:1784938031.064446:0:6611:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeac700 x1871643065473280/t0(0) o700->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:32/10 lens 264/248 e 0 to 0 dl 1784938046 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938031.064470:0:6611:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeac700 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6611:1871643065473280:192.168.201.158@tcp:700: 40000000:02000000:2.0:1784938031.064489:0:6611:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1784938031.165013:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1784938031.165053:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1784938031.165311:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7842:x1871643065473152:12345-192.168.201.158@tcp:700: Request processed in 185963us (186579us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938031.165338:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:3.0:1784938031.165838:0:7842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeaf800 x1871643065473152/t0(0) o700->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:31/4 lens 264/248 e 0 to 0 dl 1784938046 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938031.165853:0:7842:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1784938031.165881:0:7842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeaf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065473152:192.168.201.158@tcp:700: 00000004:02000040:3.0:1784938031.235579:0:7842:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1784938031.244526:0:7842:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065473408:192.168.201.158@tcp:5: 00000100:00100000:3.0:1784938031.244677:0:7842:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad09f4b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938031.245042:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938031.245751:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473408 00000100:00100000:2.0:1784938031.245765:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473408 00000100:00100000:2.0:1784938031.245845:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:2.0:1784938031.245959:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7842:x1871643065473408:12345-192.168.201.158@tcp:5: 00002000:00080000:3.0:1784938031.269644:0:6602:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1784938031.269677:0:6602:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1784938031.274668:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7842:x1871643065473408:12345-192.168.201.158@tcp:5: Request processed in 28696us (29612us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784938031.274686:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 7 00010000:00080000:2.0:1784938031.279041:0:7842:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afb422a00 x1871643065473408/t0(0) o5->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 432/432 e 0 to 0 dl 1784938047 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938031.279070:0:7842:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb422a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7842:1871643065473408:192.168.201.158@tcp:5: 00000004:00080000:2.0:1784938031.279092:0:7842:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1784938031.986566:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938033.012537:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938033.714653:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065473536:192.168.201.158@tcp:13: 00000100:00100000:0.0:1784938033.715945:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938033.716253:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473536 00000100:00100000:3.0:1784938033.716265:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473536 00000100:00080000:1.0:1784938033.716354:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938033.716418:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:3.0:1784938033.716433:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065473536:12345-192.168.201.158@tcp:13: 00002000:00000024:3.0:1784938033.716497:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3858759680 avail 3856662528 00000100:00100000:3.0:1784938033.716582:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065473536:12345-192.168.201.158@tcp:13: Request processed in 153us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938033.716590:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00010000:00080000:2.0:1784938033.717135:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824700 x1871643065473536/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938049 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938033.717166:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065473536:192.168.201.158@tcp:13: 00010000:00010000:1.0:1784938034.033529:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938035.057898:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938035.767925:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065474048:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.768133:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1784938035.768152:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065473664:0@lo:400: 00000100:00100000:3.0:1784938035.768272:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938035.768339:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065474176:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.768407:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065473920:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.768449:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784938035.768457:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065473792:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.768482:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065474304:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.768523:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473664 00000100:00100000:3.0:1784938035.768533:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473664 00000100:00100000:3.0:1784938035.768595:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1784938035.772809:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938035.772922:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938035.772961:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938035.772989:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938035.773009:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938035.773047:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474176 00000100:00100000:2.0:1784938035.773059:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474176 00000100:00100000:2.0:1784938035.773132:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473792 00000100:00100000:2.0:1784938035.773135:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473792 00000100:00100000:2.0:1784938035.773148:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065473920 00000100:00100000:2.0:1784938035.773151:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065473920 00000100:00100000:2.0:1784938035.773171:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:2.0:1784938035.773183:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065474176:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938035.773732:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065474176:12345-192.168.201.158@tcp:400: Request processed in 547us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938035.773743:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:2.0:1784938035.773773:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00100000:2.0:1784938035.773782:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065473792:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938035.773814:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065473792:12345-192.168.201.158@tcp:400: Request processed in 34us (892us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938035.773820:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00100000:2.0:1784938035.773831:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 19 00000100:00100000:2.0:1784938035.773838:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065473920:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938035.773862:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065473920:12345-192.168.201.158@tcp:400: Request processed in 25us (873us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938035.773868:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 19 00000100:00100000:2.0:1784938035.774696:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474048 00000100:00100000:2.0:1784938035.774724:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474048 00000100:00100000:2.0:1784938035.774769:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474304 00000100:00100000:2.0:1784938035.774772:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474304 00000100:00100000:2.0:1784938035.774793:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:2.0:1784938035.774800:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065474048:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938035.774850:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065474048:12345-192.168.201.158@tcp:400: Request processed in 49us (1887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938035.774856:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:2.0:1784938035.774871:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:2.0:1784938035.774877:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1871643065474304:12345-192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.775009:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065473664:12345-0@lo:400: 00000100:00080000:2.0:1784938035.779928:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938035.779942:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938035.779947:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938035.781500:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1871643065474304:12345-192.168.201.158@tcp:400: Request processed in 6606us (8473us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938035.781519:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00010000:00080000:3.0:1784938035.787483:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afb421880 x1871643065473792/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938035.787512:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065473792:192.168.201.158@tcp:400: 00010000:00080000:3.0:1784938035.787530:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afb423800 x1871643065474304/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938035.787541:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb423800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065474304:192.168.201.158@tcp:400: 00010000:00080000:3.0:1784938035.787554:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afb420000 x1871643065473920/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938035.787563:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065473920:192.168.201.158@tcp:400: 00010000:00080000:3.0:1784938035.787620:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afb421c00 x1871643065474176/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938035.787630:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065474176:192.168.201.158@tcp:400: 00010000:00080000:3.0:1784938035.787669:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afb423480 x1871643065474048/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938035.787679:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb423480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065474048:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938035.787811:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065473664:12345-0@lo:400: Request processed in 19205us (19538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938035.787825:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1784938035.787865:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065473664:0@lo:400: 00000001:00080000:3.0:1784938035.839831:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1784938036.084621:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938036.273706:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065474432:192.168.201.158@tcp:13: 00000100:00100000:3.0:1784938036.275715:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938036.275777:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474432 00000100:00100000:2.0:1784938036.275789:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474432 00000100:00100000:2.0:1784938036.275847:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:2.0:1784938036.275856:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065474432:12345-192.168.201.158@tcp:13: 00002000:00000024:2.0:1784938036.275907:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938036.277812:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065474432:12345-192.168.201.158@tcp:13: Request processed in 1942us (2096us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938036.277830:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 7 00010000:00080000:2.0:1784938036.283045:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeadf80 x1871643065474432/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938036.283066:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1784938036.283125:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065474432:192.168.201.158@tcp:13: 00000100:00100000:2.0:1784938036.324882:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938036.325048:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048673408 00000100:00100000:3.0:1784938036.325073:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048673408 00000100:00100000:3.0:1784938036.325159:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:3.0:1784938036.325172:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2354:x1871643048673408:12345-192.168.201.58@tcp:250: 00010000:00080000:3.0:1784938036.325258:0:5797:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from f5b339e0-ff01-4453-ac96-ac32d638de32@192.168.201.58@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:3.0:1784938036.325327:0:5797:0:(genops.c:1406:class_connect()) connect: client f5b339e0-ff01-4453-ac96-ac32d638de32, cookie 0xea86628a8aec3697 00000100:00080000:3.0:1784938036.325586:0:5797:0:(import.c:65:import_set_state_nolock()) ffffa05aee04c800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938036.325707:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+5:2354:x1871643048673408:12345-192.168.201.58@tcp:250: Request processed in 536us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.325717:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:3.0:1784938036.340376:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938036.340561:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048673536 00000100:00100000:1.0:1784938036.340577:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048673536 00000100:00100000:1.0:1784938036.340646:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:1.0:1784938036.340670:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+5:5559:x1871643048673536:12345-192.168.201.58@tcp:101: 00010000:00010000:1.0:1784938036.340693:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938036.340715:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897752 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938036.340752:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938036.340765:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 6 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938036.340777:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991e00, rc 0) 00000100:00100000:1.0:1784938036.340862:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+6:5559:x1871643048673536:12345-192.168.201.58@tcp:101: Request processed in 193us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938036.340871:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:3.0:1784938036.357148:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938036.357754:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048673664 00000100:00100000:2.0:1784938036.357770:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048673664 00000100:00100000:2.0:1784938036.357848:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:2.0:1784938036.357860:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+6:5559:x1871643048673664:12345-192.168.201.58@tcp:501: 00000100:00100000:2.0:1784938036.358366:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+6:5559:x1871643048673664:12345-192.168.201.58@tcp:501: Request processed in 506us (1232us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938036.358376:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:0.0:1784938036.361276:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938036.361763:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048673792 00000100:00100000:3.0:1784938036.361782:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048673792 00000100:00100000:3.0:1784938036.361850:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:3.0:1784938036.361874:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+6:5559:x1871643048673792:12345-192.168.201.58@tcp:101: 00010000:00010000:3.0:1784938036.361898:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938036.361920:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897759 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938036.363043:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938036.363106:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938036.363119:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b600, rc 0) 00000100:00100000:3.0:1784938036.363365:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+7:5559:x1871643048673792:12345-192.168.201.58@tcp:101: Request processed in 1490us (2146us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.363375:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:0.0:1784938036.383038:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938036.383097:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048673920 00000100:00100000:0.0:1784938036.383114:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048673920 00000100:00100000:0.0:1784938036.383176:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:0.0:1784938036.383189:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+7:5559:x1871643048673920:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1784938036.383889:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5559:x1871643048673920:12345-192.168.201.58@tcp:501: Request processed in 697us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938036.383900:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:3.0:1784938036.388034:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938036.388094:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674048 00000100:00100000:3.0:1784938036.388106:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674048 00000100:00100000:3.0:1784938036.388276:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:3.0:1784938036.388290:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5559:x1871643048674048:12345-192.168.201.58@tcp:503: 00000100:00100000:3.0:1784938036.389245:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5559:x1871643048674048:12345-192.168.201.58@tcp:503: Request processed in 922us (1190us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.389257:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:1.0:1784938036.397804:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938036.398341:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674176 00000100:00100000:0.0:1784938036.398356:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674176 00000100:00100000:0.0:1784938036.398440:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1784938036.398452:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5578:x1871643048674176:12345-192.168.201.58@tcp:502: 00000100:00100000:0.0:1784938036.398847:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5578:x1871643048674176:12345-192.168.201.58@tcp:502: Request processed in 396us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938036.398856:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:3.0:1784938036.432550:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938036.432606:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674304 00000100:00100000:3.0:1784938036.432619:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674304 00000100:00100000:3.0:1784938036.432684:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1784938036.432696:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5578:x1871643048674304:12345-192.168.201.58@tcp:502: 00000100:00100000:3.0:1784938036.433540:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5578:x1871643048674304:12345-192.168.201.58@tcp:502: Request processed in 840us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.433551:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:2.0:1784938036.460159:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938036.460416:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674432 00000100:00100000:0.0:1784938036.460431:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674432 00000100:00100000:0.0:1784938036.460541:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1784938036.460553:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5559:x1871643048674432:12345-192.168.201.58@tcp:101: 00010000:00010000:0.0:1784938036.460575:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938036.460599:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030600/0xea86628a8aec36ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897783 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938036.460658:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030600/0xea86628a8aec36ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897783 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938036.460672:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030600/0xea86628a8aec36ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897783 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938036.460683:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030600, rc 0) 00000100:00100000:0.0:1784938036.460764:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5559:x1871643048674432:12345-192.168.201.58@tcp:101: Request processed in 213us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938036.460771:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1784938036.475634:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938036.479861:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674560 00000100:00100000:1.0:1784938036.479884:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674560 00000100:00100000:1.0:1784938036.479967:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:1.0:1784938036.479980:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5559:x1871643048674560:12345-192.168.201.58@tcp:256: 20000000:01000000:1.0:1784938036.480016:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784938036.480041:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784938036.480046:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784938036.480049:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784938036.480051:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1784938036.482814:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5559:x1871643048674560:12345-192.168.201.58@tcp:256: Request processed in 2821us (7179us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.482833:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:3.0:1784938036.487850:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938036.487895:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674688 00000100:00100000:3.0:1784938036.487908:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674688 00000100:00100000:3.0:1784938036.488109:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:3.0:1784938036.488123:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5559:x1871643048674688:12345-192.168.201.58@tcp:101: 00010000:00010000:3.0:1784938036.488148:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938036.488171:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89778a expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938036.488207:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938036.488255:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938036.488268:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:3.0:1784938036.488455:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5559:x1871643048674688:12345-192.168.201.58@tcp:101: Request processed in 334us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.488464:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:0.0:1784938036.498126:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938036.498276:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674816 00000100:00100000:2.0:1784938036.498291:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674816 00000100:00100000:2.0:1784938036.498364:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:2.0:1784938036.498376:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5559:x1871643048674816:12345-192.168.201.58@tcp:501: 00000100:00100000:2.0:1784938036.498742:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5559:x1871643048674816:12345-192.168.201.58@tcp:501: Request processed in 367us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938036.498752:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:1.0:1784938036.504156:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938036.504590:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048674944 00000100:00100000:2.0:1784938036.504604:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048674944 00000100:00100000:2.0:1784938036.504674:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:2.0:1784938036.504686:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5559:x1871643048674944:12345-192.168.201.58@tcp:503: 00000100:00100000:2.0:1784938036.505286:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5559:x1871643048674944:12345-192.168.201.58@tcp:503: Request processed in 598us (1142us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938036.505296:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:2.0:1784938036.509390:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938036.509501:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675072 00000100:00100000:1.0:1784938036.509515:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675072 00000100:00100000:1.0:1784938036.509609:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:1.0:1784938036.509622:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5584:x1871643048675072:12345-192.168.201.58@tcp:502: 00000100:00100000:1.0:1784938036.510078:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5584:x1871643048675072:12345-192.168.201.58@tcp:502: Request processed in 457us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938036.510088:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:1.0:1784938036.516122:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938036.516511:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675200 00000100:00100000:3.0:1784938036.516524:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675200 00000100:00100000:3.0:1784938036.516603:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:3.0:1784938036.516615:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5584:x1871643048675200:12345-192.168.201.58@tcp:502: 00000100:00100000:3.0:1784938036.520240:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5584:x1871643048675200:12345-192.168.201.58@tcp:502: Request processed in 2695us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.520259:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:3.0:1784938036.529620:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938036.530116:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675328 00000100:00100000:2.0:1784938036.530140:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675328 00000100:00100000:2.0:1784938036.530205:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1784938036.530623:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2354:x1871643048675328:12345-192.168.201.58@tcp:38: 00010000:00080000:2.0:1784938036.530670:0:7211:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp t0 exp 0000000000000000 cur 245 last 0 00000020:00000080:2.0:1784938036.530739:0:7211:0:(genops.c:1406:class_connect()) connect: client 8bbc0047-63c1-4cac-b5e6-ede401808e2e, cookie 0xea86628a8aec36ba 00000004:00100000:2.0:1784938036.530781:0:7211:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1784938036.530789:0:7211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1784938036.565886:0:7211:0:(import.c:65:import_set_state_nolock()) ffffa05aee04e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938036.566135:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2354:x1871643048675328:12345-192.168.201.58@tcp:38: Request processed in 35917us (36528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938036.566155:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00010000:00010000:3.0:1784938037.106053:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938037.571180:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938037.571327:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675584 00000100:00100000:0.0:1784938037.571338:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675584 00000100:00100000:0.0:1784938037.571433:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1784938037.571445:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5559:x1871643048675584:12345-192.168.201.58@tcp:41: 00000004:00000024:0.0:1784938037.571492:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784938037.571572:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5559:x1871643048675584:12345-192.168.201.58@tcp:41: Request processed in 129us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938037.571580:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00080000:2.0:1784938037.572248:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938037.573944:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938037.574058:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675456 00000100:00100000:0.0:1784938037.574072:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675456 00000100:00100000:0.0:1784938037.574179:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784938037.574190:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:0:x1871643048675456:12345-192.168.201.58@tcp:41: 00000004:00000024:0.0:1784938037.574264:0:5804:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1784938037.574336:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:0:x1871643048675456:12345-192.168.201.58@tcp:41: Request processed in 147us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938037.574355:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784938037.575935:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938037.576022:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675712 00000100:00100000:2.0:1784938037.576035:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675712 00000100:00100000:2.0:1784938037.576090:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784938037.576100:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5559:x1871643048675712:12345-192.168.201.58@tcp:40: 00000100:00100000:2.0:1784938037.576190:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5559:x1871643048675712:12345-192.168.201.58@tcp:40: Request processed in 91us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938037.576198:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784938037.590463:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938037.590499:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938037.590533:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938037.590568:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938037.590615:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676224 00000100:00100000:0.0:1784938037.590625:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676224 00000100:00100000:0.0:1784938037.590674:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:0.0:1784938037.590700:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048676224:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1784938037.590774:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048676224:12345-192.168.201.58@tcp:400: Request processed in 91us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938037.590783:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:0.0:1784938037.590839:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675840 00000100:00100000:0.0:1784938037.590843:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675840 00000100:00100000:0.0:1784938037.590869:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048675968 00000100:00100000:0.0:1784938037.590872:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048675968 00000100:00100000:1.0:1784938037.590983:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1784938037.590989:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2354:x1871643048675840:12345-192.168.201.58@tcp:8: 00010000:00080000:1.0:1784938037.591015:0:6602:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:1.0:1784938037.591047:0:6602:0:(genops.c:1406:class_connect()) connect: client 8bbc0047-63c1-4cac-b5e6-ede401808e2e, cookie 0xea86628a8aec36c1 00002000:00100000:1.0:1784938037.591059:0:6602:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8bbc0047-63c1-4cac-b5e6-ede401808e2e/ffffa05ae1726000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938037.591088:0:6602:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938037.591463:0:6602:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938037.591499:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa05ae1721800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938037.591532:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2354:x1871643048675840:12345-192.168.201.58@tcp:8: Request processed in 541us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938037.591538:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784938037.592795:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676096 00000100:00100000:3.0:1784938037.592807:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676096 00000100:00100000:3.0:1784938037.592872:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784938037.592889:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5559:x1871643048676096:12345-192.168.201.58@tcp:33: 00000100:00100000:0.0:1784938037.595308:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1784938037.595319:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1871643048675968:12345-192.168.201.58@tcp:8: 00010000:00080000:0.0:1784938037.595353:0:6605:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1784938037.595388:0:6605:0:(genops.c:1406:class_connect()) connect: client 8bbc0047-63c1-4cac-b5e6-ede401808e2e, cookie 0xea86628a8aec36c8 00002000:00100000:0.0:1784938037.595402:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bbc0047-63c1-4cac-b5e6-ede401808e2e/ffffa059c34f7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784938037.595415:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938037.599395:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938037.599453:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ae1723800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938037.599536:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2354:x1871643048675968:12345-192.168.201.58@tcp:8: Request processed in 4215us (8965us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938037.599548:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000004:00080000:3.0:1784938037.641081:0:5807:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 48128us 00000004:00200000:0.0:1784938037.663141:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1784938037.663369:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5559:x1871643048676096:12345-192.168.201.58@tcp:33: Request processed in 70476us (72911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938037.663403:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784938037.901585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938037.902262:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676352 00000100:00100000:3.0:1784938037.902279:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676352 00000100:00100000:3.0:1784938037.902380:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784938037.902393:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5601:x1871643048676352:12345-192.168.201.58@tcp:101: 00010000:00010000:3.0:1784938037.902426:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938037.904747:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11ae00/0xea86628a8aec36cf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8977b4 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938037.905075:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec36d6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938037.905109:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938037.905127:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938037.905423:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784938037.905428:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938037.906925:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938037.906985:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11ae00/0xea86628a8aec36cf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977b4 expref: 8 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938037.907009:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec36d6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977b4 expref: 7 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938037.907019:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861400) 00010000:00010000:3.0:1784938037.907022:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938037.907026:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a000, rc 0) 00000100:00100000:3.0:1784938037.907168:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:5601:x1871643048676352:12345-192.168.201.58@tcp:101: Request processed in 4776us (5596us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938037.907178:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00010000:00010000:1.0:1784938038.130006:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938038.834239:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938038.834280:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065474560:192.168.201.158@tcp:13: 00000100:00100000:2.0:1784938038.835144:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938038.835592:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474560 00000100:00100000:1.0:1784938038.835606:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474560 00000100:00080000:2.0:1784938038.835684:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938038.835692:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:1.0:1784938038.835705:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065474560:12345-192.168.201.158@tcp:13: 00002000:00000024:1.0:1784938038.835739:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3858759680 avail 3856662528 00000100:00100000:1.0:1784938038.835809:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065474560:12345-192.168.201.158@tcp:13: Request processed in 107us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938038.835818:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 8 00010000:00080000:3.0:1784938038.836157:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824a80 x1871643065474560/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938054 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938038.836273:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065474560:192.168.201.158@tcp:13: 00000001:00100000:1.0:1784938038.920595:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00010000:00010000:3.0:1784938039.156427:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938040.183397:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938040.393561:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938040.393803:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676480 00000100:00100000:3.0:1784938040.393820:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676480 00000100:00100000:3.0:1784938040.394312:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1784938040.394327:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:5653:x1871643048676480:12345-192.168.201.58@tcp:41: 00000004:00000024:3.0:1784938040.394392:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1784938040.394493:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:5653:x1871643048676480:12345-192.168.201.58@tcp:41: Request processed in 170us (946us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938040.394501:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:2.0:1784938040.395165:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938040.401769:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938040.407035:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676608 00000100:00100000:2.0:1784938040.407056:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676608 00000100:00100000:2.0:1784938040.407196:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1784938040.407210:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:5653:x1871643048676608:12345-192.168.201.58@tcp:13: 00002000:00000024:2.0:1784938040.407305:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938040.407421:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:5653:x1871643048676608:12345-192.168.201.58@tcp:13: Request processed in 215us (5672us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938040.407455:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:1.0:1784938040.408311:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938040.413942:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938040.414523:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676736 00000100:00100000:2.0:1784938040.414538:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676736 00000100:00100000:2.0:1784938040.414628:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1784938040.414639:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5653:x1871643048676736:12345-192.168.201.58@tcp:13: 00002000:00000024:2.0:1784938040.414702:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938040.414806:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:5653:x1871643048676736:12345-192.168.201.58@tcp:13: Request processed in 168us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938040.414814:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00080000:1.0:1784938040.416176:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938040.882001:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065475072:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.882200:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938040.882209:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065474688:0@lo:400: 00000100:00100000:0.0:1784938040.882307:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938040.882345:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065475200:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.882402:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065474816:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.882435:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065475328:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.882464:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938040.882470:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065474944:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.882703:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938040.882763:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938040.882784:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938040.882831:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938040.882856:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938040.882884:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475200 00000100:00100000:0.0:1784938040.882895:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475200 00000100:00100000:0.0:1784938040.882965:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474816 00000100:00100000:0.0:1784938040.882968:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474816 00000100:00100000:0.0:1784938040.882982:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474944 00000100:00100000:0.0:1784938040.882984:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474944 00000100:00100000:0.0:1784938040.883003:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 20 00000100:00100000:0.0:1784938040.883013:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065475200:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.883090:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065475200:12345-192.168.201.158@tcp:400: Request processed in 77us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938040.883099:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 20 00000100:00100000:0.0:1784938040.883118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00100000:0.0:1784938040.883125:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065474816:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.883166:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065474816:12345-192.168.201.158@tcp:400: Request processed in 25us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938040.883174:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00100000:0.0:1784938040.883186:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:0.0:1784938040.883192:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065474944:12345-192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.883248:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065474944:12345-192.168.201.158@tcp:400: Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938040.883256:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:0.0:1784938040.883409:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065474944:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.883423:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065474816:192.168.201.158@tcp:400: 00000100:00100000:0.0:1784938040.883466:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065475200:192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938040.884873:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475328 00000100:00100000:1.0:1784938040.884888:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475328 00000100:00100000:1.0:1784938040.884981:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475072 00000100:00100000:1.0:1784938040.884986:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475072 00000100:00100000:1.0:1784938040.885013:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:1.0:1784938040.885024:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065475328:12345-192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938040.885125:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065475328:12345-192.168.201.158@tcp:400: Request processed in 102us (2360us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938040.885134:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:1.0:1784938040.885163:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:1.0:1784938040.885171:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065475072:12345-192.168.201.158@tcp:400: 00000100:00100000:1.0:1784938040.885198:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065475072:12345-192.168.201.158@tcp:400: Request processed in 28us (2413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938040.885270:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00080000:1.0:1784938040.885298:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938040.885303:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938040.885307:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784938040.885576:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2826d80 x1871643065475328/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938040.885594:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065475328:192.168.201.158@tcp:400: 00010000:00080000:1.0:1784938040.885665:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2827100 x1871643065475072/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938040.885675:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2827100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065475072:192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938040.886504:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065474688 00000100:00100000:3.0:1784938040.886516:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065474688 00000100:00100000:3.0:1784938040.886569:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784938040.886579:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065474688:12345-0@lo:400: 00000100:00100000:3.0:1784938040.886681:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065474688:12345-0@lo:400: Request processed in 104us (4374us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938040.886689:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1784938040.886746:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065474688:0@lo:400: 00010000:00010000:3.0:1784938041.202036:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938041.393482:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938041.400031:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065475456:192.168.201.158@tcp:13: 00000100:00100000:1.0:1784938041.400672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938041.400717:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475456 00000100:00100000:1.0:1784938041.400731:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475456 00000100:00100000:1.0:1784938041.400830:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:1.0:1784938041.400842:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065475456:12345-192.168.201.158@tcp:13: 00002000:00000024:1.0:1784938041.400885:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938041.400951:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065475456:12345-192.168.201.158@tcp:13: Request processed in 110us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938041.400961:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 11 00010000:00080000:1.0:1784938041.401110:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52ba300 x1871643065475456/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938041.401151:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065475456:192.168.201.158@tcp:13: 00000001:00100000:0.0:1784938041.993007:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000001:00100000:1.0:1784938041.994858:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00010000:00010000:1.0:1784938042.241995:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938042.809806:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938042.809873:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938042.809922:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938042.809965:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938042.810009:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677248 00000100:00100000:1.0:1784938042.810023:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677248 00000100:00100000:3.0:1784938042.810043:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676864 00000100:00100000:3.0:1784938042.810047:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676864 00000100:00100000:1.0:1784938042.810095:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677120 00000100:00100000:1.0:1784938042.810098:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677120 00000100:00100000:3.0:1784938042.810101:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:3.0:1784938042.810112:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2355:x1871643048676864:12345-192.168.201.58@tcp:400: 00000100:00100000:1.0:1784938042.810114:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784938042.810145:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048677248:12345-192.168.201.58@tcp:400: 00000100:00100000:2.0:1784938042.810274:0:6604:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938042.810288:0:6604:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1784938042.810466:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784938042.810474:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048677120:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1784938042.810533:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048676992 00000100:00100000:0.0:1784938042.810538:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048676992 00000100:00100000:0.0:1784938042.810582:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1784938042.810590:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048676992:12345-192.168.201.58@tcp:400: 00000100:00100000:3.0:1784938042.814833:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2355:x1871643048676864:12345-192.168.201.58@tcp:400: Request processed in 2791us (2977us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938042.814872:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00080000:3.0:1784938042.815559:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938042.815567:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938042.815571:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938042.819488:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048677248:12345-192.168.201.58@tcp:400: Request processed in 9320us (9590us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938042.819509:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784938042.824345:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048677120:12345-192.168.201.58@tcp:400: Request processed in 13850us (14358us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938042.824368:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784938042.829016:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048676992:12345-192.168.201.58@tcp:400: Request processed in 18404us (19205us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938042.829036:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00010000:00010000:3.0:1784938043.249669:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938043.969247:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938043.969284:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065475584:192.168.201.158@tcp:13: 00000100:00100000:2.0:1784938043.969612:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938043.969645:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475584 00000100:00100000:2.0:1784938043.969654:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475584 00000100:00100000:2.0:1784938043.969728:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:2.0:1784938043.969739:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065475584:12345-192.168.201.158@tcp:13: 00002000:00000024:2.0:1784938043.969785:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938043.969833:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065475584:12345-192.168.201.158@tcp:13: Request processed in 95us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938043.969851:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00080000:2.0:1784938043.969875:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938043.970018:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52b8e00 x1871643065475584/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938059 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938043.970040:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065475584:192.168.201.158@tcp:13: 00000001:02000400:2.0:1784938044.030104:0:8164:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1784938044.279164:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938045.302422:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938046.003278:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065475712:0@lo:400: 00000100:00100000:2.0:1784938046.003380:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938046.003449:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065476224:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.003528:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938046.003537:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065476096:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.003585:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065475840:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.003628:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065476352:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.003655:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938046.003661:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065475968:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.003708:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475712 00000100:00100000:2.0:1784938046.003717:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475712 00000100:00100000:2.0:1784938046.004786:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784938046.004800:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065475712:12345-0@lo:400: 00000100:00100000:2.0:1784938046.004899:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065475712:12345-0@lo:400: Request processed in 102us (1518us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938046.004907:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1784938046.005370:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938046.008051:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938046.008117:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938046.008139:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938046.008777:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065476224 00000100:00100000:3.0:1784938046.008791:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065476224 00000100:00100000:3.0:1784938046.008882:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475840 00000100:00100000:3.0:1784938046.008885:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475840 00000100:00100000:3.0:1784938046.008904:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065475968 00000100:00100000:3.0:1784938046.008907:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065475968 00000100:00100000:3.0:1784938046.008931:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00100000:3.0:1784938046.008944:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065476224:12345-192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938046.009630:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065476224:12345-192.168.201.158@tcp:400: Request processed in 684us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938046.009641:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00100000:3.0:1784938046.009671:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 25 00000100:00100000:3.0:1784938046.009679:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065475840:12345-192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938046.009707:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065475840:12345-192.168.201.158@tcp:400: Request processed in 29us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938046.009714:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 25 00000100:00100000:3.0:1784938046.009725:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00100000:3.0:1784938046.009832:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065475968:12345-192.168.201.158@tcp:400: 00000100:00100000:3.0:1784938046.009859:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065475968:12345-192.168.201.158@tcp:400: Request processed in 31us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938046.009866:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00100000:2.0:1784938046.013271:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938046.013407:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065475712:0@lo:400: 00000100:00100000:2.0:1784938046.013429:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065476224:192.168.201.158@tcp:400: 00000100:00080000:2.0:1784938046.013473:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938046.013495:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065476096 00000100:00100000:2.0:1784938046.013504:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065476096 00000100:00100000:2.0:1784938046.013571:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065476352 00000100:00100000:2.0:1784938046.013574:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065476352 00000100:00100000:2.0:1784938046.013613:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:2.0:1784938046.013623:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065476096:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.013715:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065476096:12345-192.168.201.158@tcp:400: Request processed in 92us (8346us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938046.013724:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:2.0:1784938046.013757:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:2.0:1784938046.013764:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065476352:12345-192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.013791:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065476352:12345-192.168.201.158@tcp:400: Request processed in 28us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938046.013796:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:2.0:1784938046.013828:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065475968:192.168.201.158@tcp:400: 00000100:00100000:2.0:1784938046.013839:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065475840:192.168.201.158@tcp:400: 00000100:00080000:2.0:1784938046.013858:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938046.013861:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938046.014122:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52b8700 x1871643065476096/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938046.014134:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065476096:192.168.201.158@tcp:400: 00010000:00080000:2.0:1784938046.014181:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52b8000 x1871643065476352/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938062 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938046.014190:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065476352:192.168.201.158@tcp:400: 00010000:00010000:1.0:1784938046.321465:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938046.514024:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938046.514069:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065476480:192.168.201.158@tcp:13: 00000100:00100000:1.0:1784938046.514629:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938046.514867:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065476480 00000100:00100000:2.0:1784938046.514880:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065476480 00000100:00100000:2.0:1784938046.514951:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:2.0:1784938046.514962:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065476480:12345-192.168.201.158@tcp:13: 00002000:00000024:2.0:1784938046.515009:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938046.515087:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065476480:12345-192.168.201.158@tcp:13: Request processed in 126us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938046.515096:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 13 00010000:00080000:2.0:1784938046.515406:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52b8000 x1871643065476480/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938046.515429:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065476480:192.168.201.158@tcp:13: 00010000:00010000:3.0:1784938047.346604:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938047.923840:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938047.923890:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938047.924093:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677504 00000100:00100000:0.0:1784938047.924117:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677504 00000100:00100000:0.0:1784938047.924247:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:0.0:1784938047.924260:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048677504:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1784938047.924372:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048677504:12345-192.168.201.58@tcp:400: Request processed in 115us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938047.924380:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00080000:0.0:1784938047.924408:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938047.925027:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938047.925123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938047.925163:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677760 00000100:00100000:3.0:1784938047.925172:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677760 00000100:00100000:3.0:1784938047.925246:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677632 00000100:00100000:3.0:1784938047.925250:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677632 00000100:00100000:3.0:1784938047.925291:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784938047.925303:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048677760:12345-192.168.201.58@tcp:400: 00000100:00100000:3.0:1784938047.925369:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048677760:12345-192.168.201.58@tcp:400: Request processed in 69us (1477us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938047.925379:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784938047.925401:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:3.0:1784938047.925408:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048677632:12345-192.168.201.58@tcp:400: 00000100:00100000:3.0:1784938047.925439:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb422a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048677632:12345-192.168.201.58@tcp:400: Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938047.925446:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1784938047.926121:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677376 00000100:00100000:0.0:1784938047.926131:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677376 00000100:00100000:0.0:1784938047.926178:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:0.0:1784938047.926186:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048677376:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1784938047.926253:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048677376:12345-192.168.201.58@tcp:400: Request processed in 68us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938047.926260:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00080000:0.0:1784938047.926297:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938047.926302:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00000080:0.0:1784938048.367408:0:8313:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd88341980 20000000:00000080:0.0:1784938048.367437:0:8313:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa05ad1a1fc00 uarg=0000000000000000 20000000:01000000:0.0:1784938048.367498:0:8313:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1784938048.367502:0:8313:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1784938048.367506:0:8313:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784938048.367514:0:8313:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1784938048.367522:0:8313:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1784938048.367553:0:8313:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784938048.367556:0:8313:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1784938048.368146:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1784938048.368151:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784938048.369849:0:8314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1784938048.370643:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1784938048.370718:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1784938048.370759:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1784938048.370772:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1784938048.370775:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00010000:00010000:1.0:1784938048.371687:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784938048.372106:0:8315:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1784938048.372872:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1784938048.372933:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1784938048.372996:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1784938048.373013:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1784938048.373015:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1784938048.375406:0:8316:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1784938048.376120:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1784938048.376183:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1784938048.376261:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1784938048.376276:0:8313:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1784938048.376279:0:8313:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1784938048.383808:0:8317:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1784938048.390613:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1784938048.390724:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1784938048.390766:0:8313:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1784938048.390793:0:8313:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1784938048.390820:0:8313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390844:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390870:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35fd expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390878:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3627 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390884:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3635 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390891:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3643 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390897:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec365f expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390903:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3689 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390914:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390921:0:8313:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.390929:0:8313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391003:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391048:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 9 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.391068:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476608:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938048.391210:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391250:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 9 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.391259:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476736:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938048.391294:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3689 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391302:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3689 expref: 18 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.391311:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476864:0@lo:104: 00000100:00100000:3.0:1784938048.391358:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1784938048.391399:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec365f expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391408:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec365f expref: 18 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.391416:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476992:0@lo:104: 00000100:00100000:3.0:1784938048.391443:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938048.391506:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784938048.391520:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065476864 00000100:00100000:3.0:1784938048.391528:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065476864 00000100:00100000:3.0:1784938048.391574:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065476992 00000100:00100000:3.0:1784938048.391577:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065476992 00000100:00100000:3.0:1784938048.391591:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938048.391600:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:8313:x1871643065476864:12345-0@lo:104: 00010000:00010000:3.0:1784938048.391615:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391670:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938048.391676:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:8313:x1871643065476864:12345-0@lo:104: Request processed in 76us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.391684:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1784938048.391703:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1784938048.391710:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee047450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065476992:12345-0@lo:104: 00010000:00010000:3.0:1784938048.391717:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391749:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1784938048.391754:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee047450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065476992:12345-0@lo:104: Request processed in 46us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.391760:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1784938048.391824:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938048.391833:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391842:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938048.391847:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391867:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938048.391876:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938048.391883:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938048.391916:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391923:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938048.391946:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391953:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3689 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3690 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391968:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938048.391972:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391977:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938048.391980:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.391987:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938048.391994:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938048.392005:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938048.392033:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392039:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938048.392046:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392052:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac8991200/0xea86628a8aec365f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3666 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392062:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392063:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392065:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392088:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3643 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392098:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3643 expref: 18 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.392107:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065477376:0@lo:104: 00000100:00100000:3.0:1784938048.392135:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938048.392158:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477376 00000100:00100000:3.0:1784938048.392162:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477376 00000100:00100000:3.0:1784938048.392183:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1784938048.392189:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065477376:12345-0@lo:104: 00010000:00010000:3.0:1784938048.392197:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392275:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938048.392281:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065477376:12345-0@lo:104: Request processed in 92us (145us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.392287:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:3.0:1784938048.392301:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938048.392304:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392325:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938048.392328:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392335:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938048.392341:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938048.392346:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938048.392361:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392368:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938048.392384:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392391:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec364a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392413:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392415:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392416:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392433:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3635 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392442:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3635 expref: 18 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.392451:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065477632:0@lo:104: 00000100:00100000:3.0:1784938048.392474:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938048.392493:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477632 00000100:00100000:3.0:1784938048.392496:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477632 00000100:00100000:3.0:1784938048.392512:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1784938048.392518:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065477632:12345-0@lo:104: 00010000:00010000:3.0:1784938048.392526:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392556:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938048.392561:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065477632:12345-0@lo:104: Request processed in 44us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.392567:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:3.0:1784938048.392581:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938048.392586:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392591:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938048.392594:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392607:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938048.392613:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938048.392618:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938048.392633:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392639:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938048.392644:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392651:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec363c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392663:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392665:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392666:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392687:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3627 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392695:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3627 expref: 18 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.392704:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065477888:0@lo:104: 00000100:00100000:3.0:1784938048.392729:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938048.392748:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477888 00000100:00100000:3.0:1784938048.392757:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477888 00000100:00100000:3.0:1784938048.392775:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1784938048.392780:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065477888:12345-0@lo:104: 00010000:00010000:3.0:1784938048.392788:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392819:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938048.392825:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065477888:12345-0@lo:104: Request processed in 45us (95us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.392831:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:3.0:1784938048.392848:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938048.392852:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392858:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11bc00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938048.392861:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392868:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938048.392874:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938048.392879:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938048.392894:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392900:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938048.392904:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392917:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11bc00/0xea86628a8aec3627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec362e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392926:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392928:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392930:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938048.392949:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec35fd expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.392958:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec35fd expref: 18 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938048.392966:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065478144:0@lo:104: 00000100:00100000:3.0:1784938048.392989:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938048.393007:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478144 00000100:00100000:3.0:1784938048.393010:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478144 00000100:00100000:1.0:1784938048.393453:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065477760:0@lo:103: 00000100:00100000:1.0:1784938048.393486:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938048.393512:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938048.393516:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065477504:0@lo:103: 00000100:00100000:1.0:1784938048.393528:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938048.393547:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477760 00000100:00100000:1.0:1784938048.393549:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477760 00010000:00010000:1.0:1784938048.393566:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3635 expref: 19 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938048.393587:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477504 00000100:00100000:1.0:1784938048.393594:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477504 00010000:00010000:1.0:1784938048.393604:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3643 expref: 20 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938048.393613:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938048.393617:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3322:x1871643065477760:12345-0@lo:103: 00010000:00010000:1.0:1784938048.393627:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938048.393630:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3635 expref: 20 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.393636:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3635 expref: 20 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.393652:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938048.393679:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3322:x1871643065477760:12345-0@lo:103: Request processed in 60us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938048.393685:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1784938048.393701:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938048.393706:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065477504:12345-0@lo:103: 00010000:00010000:1.0:1784938048.393714:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938048.393718:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3643 expref: 19 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.393726:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3643 expref: 19 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.393736:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938048.393757:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065477504:12345-0@lo:103: Request processed in 51us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938048.393763:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:1.0:1784938048.393786:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938048.393809:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065477504:0@lo:103: 00000100:00100000:1.0:1784938048.393815:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065477760:0@lo:103: 00000100:00100000:2.0:1784938048.394245:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065477120:0@lo:103: 00000100:00100000:2.0:1784938048.394279:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938048.394306:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065478016:0@lo:103: 00000100:00100000:2.0:1784938048.394620:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938048.394647:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938048.394662:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065477248:0@lo:103: 00000100:00100000:2.0:1784938048.394686:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938048.394730:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477120 00000100:00100000:2.0:1784938048.394737:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477120 00010000:00010000:2.0:1784938048.394762:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3689 expref: 19 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.394777:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478016 00000100:00100000:2.0:1784938048.394780:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478016 00010000:00010000:2.0:1784938048.394792:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3627 expref: 20 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.394801:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065477248 00000100:00100000:2.0:1784938048.394804:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065477248 00010000:00010000:2.0:1784938048.394813:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec365f expref: 21 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.394826:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784938048.394833:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+21:3323:x1871643065477120:12345-0@lo:103: 00010000:00010000:2.0:1784938048.394843:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938048.394847:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3689 expref: 21 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.394857:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3689 expref: 21 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.394870:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938048.394901:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+21:3323:x1871643065477120:12345-0@lo:103: Request processed in 68us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938048.394909:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784938048.394924:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938048.394937:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3323:x1871643065478016:12345-0@lo:103: 00010000:00010000:2.0:1784938048.394945:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938048.394950:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3627 expref: 20 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.394958:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3627 expref: 20 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.394969:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938048.394991:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3323:x1871643065478016:12345-0@lo:103: Request processed in 55us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938048.394998:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938048.395014:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938048.395029:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065477248:12345-0@lo:103: 00010000:00010000:2.0:1784938048.395039:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938048.395043:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec365f expref: 19 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.395050:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec365f expref: 19 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.395059:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938048.395079:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065477248:12345-0@lo:103: Request processed in 60us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938048.395084:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938048.395111:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065477248:0@lo:103: 00000100:00100000:2.0:1784938048.395119:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065477120:0@lo:103: 00000100:00100000:2.0:1784938048.395125:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065478016:0@lo:103: 00000100:00100000:3.0:1784938048.395750:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1784938048.395762:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065478144:12345-0@lo:104: 00010000:00010000:3.0:1784938048.395777:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938048.395833:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938048.395839:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065478144:12345-0@lo:104: Request processed in 81us (2849us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.395844:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1784938048.395888:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938048.395894:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.395903:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938048.395907:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.395917:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938048.395924:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938048.395930:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938048.395974:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.395982:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938048.395998:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.396005:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05afc893800/0xea86628a8aec35fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3604 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.396016:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938048.396018:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938048.396029:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938048.396040:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065478272:0@lo:103: 00000100:00100000:2.0:1784938048.396076:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938048.396127:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478272 00000100:00100000:2.0:1784938048.396133:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478272 00010000:00010000:2.0:1784938048.396155:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35fd expref: 19 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.396178:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938048.396185:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065478272:12345-0@lo:103: 00010000:00010000:2.0:1784938048.396194:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938048.396199:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35fd expref: 19 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.396208:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec35fd expref: 19 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.396245:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938048.396274:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065478272:12345-0@lo:103: Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938048.396279:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938048.396305:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065478272:0@lo:103: 00010000:00010000:2.0:1784938048.398322:0:8313:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.398344:0:8313:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 18 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.398361:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065478400:0@lo:104: 00000100:00100000:2.0:1784938048.398435:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938048.412202:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938048.412267:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938048.412319:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048677888 00000100:00100000:1.0:1784938048.412331:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048677888 00010000:00010000:1.0:1784938048.412387:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 10 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938048.412428:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678016 00000100:00100000:1.0:1784938048.412431:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678016 00010000:00010000:1.0:1784938048.412446:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 11 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938048.412462:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784938048.412472:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2356:x1871643048677888:12345-192.168.201.58@tcp:103: 00010000:00010000:1.0:1784938048.412492:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938048.412499:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 11 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.412514:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 11 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.412541:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938048.412615:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea3c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2356:x1871643048677888:12345-192.168.201.58@tcp:103: Request processed in 143us (428us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938048.412623:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784938048.412705:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938048.412713:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2355:x1871643048678016:12345-192.168.201.58@tcp:103: 00010000:00010000:1.0:1784938048.412720:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938048.412725:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 10 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.412735:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 10 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.412745:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938048.412764:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2355:x1871643048678016:12345-192.168.201.58@tcp:103: Request processed in 52us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938048.412771:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1784938048.413349:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac3427480 going to sleep for 11 seconds 00010000:00010000:2.0:1784938048.413387:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11b600/0xea86628a8aec36a5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897759 expref: 9 pid: 5797 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413421:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476608:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938048.413438:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8991e00/0xea86628a8aec369e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897752 expref: 8 pid: 5798 timeout: 357 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413445:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476736:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938048.413458:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3689 expref: 18 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413466:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476864:0@lo:104: 00010000:00010000:2.0:1784938048.413477:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030000/0xea86628a8aec3666 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec365f expref: 17 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413485:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065476992:0@lo:104: 00010000:00010000:2.0:1784938048.413497:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8990200/0xea86628a8aec364a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3643 expref: 16 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413504:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065477376:0@lo:104: 00010000:00010000:2.0:1784938048.413515:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11aa00/0xea86628a8aec363c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3635 expref: 15 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413524:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065477632:0@lo:104: 00010000:00010000:2.0:1784938048.413535:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893e00/0xea86628a8aec362e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3627 expref: 14 pid: 5797 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413542:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065477888:0@lo:104: 00010000:00010000:2.0:1784938048.413552:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec35fd expref: 13 pid: 5798 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.413568:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065478144:0@lo:104: 00000100:00100000:0.0:1784938048.414012:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478400 00000100:00100000:0.0:1784938048.414029:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478400 00000100:00100000:0.0:1784938048.414075:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1784938048.414082:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065478400:12345-0@lo:104: 00010000:00010000:0.0:1784938048.414096:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938048.414180:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938048.414185:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8313:x1871643065478400:12345-0@lo:104: Request processed in 105us (15752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938048.414192:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1784938048.414326:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938048.414335:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414342:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938048.414347:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414357:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938048.414364:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938048.414369:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1784938048.414418:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414431:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938048.414457:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414463:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0031600/0xea86628a8aec35d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35da expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414481:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938048.414483:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938048.414484:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938048.414501:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065478528:0@lo:103: 00000100:00100000:1.0:1784938048.414544:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938048.414583:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478528 00000100:00100000:1.0:1784938048.414586:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478528 00010000:00010000:1.0:1784938048.414606:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 13 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938048.414626:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784938048.414633:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065478528:12345-0@lo:103: 00010000:00010000:1.0:1784938048.414643:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938048.414648:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 13 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414659:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 13 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414677:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414697:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414714:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414722:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414730:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414737:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414743:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11ba00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938048.414747:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414755:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414765:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.414776:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938048.414804:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:3321:x1871643065478528:12345-0@lo:103: Request processed in 172us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938048.414811:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1784938048.414845:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065478528:0@lo:103: 00010000:00010000:2.0:1784938048.415046:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893200/0xea86628a8aec35da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec35d3 expref: 12 pid: 5799 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938048.415058:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8313:1871643065478400:0@lo:104: 00010000:00010000:2.0:1784938048.415117:0:8313:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.415128:0:8313:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.415134:0:8313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.415139:0:8313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec36dd lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938048.589395:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938048.589506:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678144 00000100:00100000:2.0:1784938048.589521:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678144 00000100:00100000:2.0:1784938048.589591:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:2.0:1784938048.589611:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+8:5573:x1871643048678144:12345-192.168.201.58@tcp:101: 00010000:00010000:2.0:1784938048.589632:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938048.589658:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893200/0xea86628a8aec36e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8977bb expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.589704:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893200/0xea86628a8aec36e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977bb expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.589739:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893200/0xea86628a8aec36e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977bb expref: 9 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938048.589751:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893200, rc 0) 00000100:00100000:2.0:1784938048.589823:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048678144:12345-192.168.201.58@tcp:101: Request processed in 222us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938048.589831:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:1.0:1784938048.601932:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938048.602050:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678272 00000100:00100000:0.0:1784938048.602080:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678272 00000100:00100000:0.0:1784938048.602165:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:0.0:1784938048.602177:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048678272:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1784938048.602951:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048678272:12345-192.168.201.58@tcp:501: Request processed in 430us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938048.602963:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:0.0:1784938048.622067:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938048.628360:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678400 00000100:00100000:3.0:1784938048.628382:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678400 00000100:00100000:3.0:1784938048.628483:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:3.0:1784938048.628515:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048678400:12345-192.168.201.58@tcp:503: 00000100:00100000:3.0:1784938048.629191:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048678400:12345-192.168.201.58@tcp:503: Request processed in 674us (7140us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.629204:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:1.0:1784938048.638840:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938048.638944:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678528 00000100:00100000:0.0:1784938048.638958:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678528 00000100:00100000:0.0:1784938048.639038:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:0.0:1784938048.639050:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+9:6041:x1871643048678528:12345-192.168.201.58@tcp:502: 00000100:00100000:0.0:1784938048.639456:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+9:6041:x1871643048678528:12345-192.168.201.58@tcp:502: Request processed in 407us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938048.639465:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:1.0:1784938048.644699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938048.644930:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678656 00000100:00100000:3.0:1784938048.644945:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678656 00000100:00100000:3.0:1784938048.645056:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:3.0:1784938048.645070:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+9:6041:x1871643048678656:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938048.650625:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+9:6041:x1871643048678656:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 5545us (5937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938048.650641:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:0.0:1784938048.657231:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938048.657822:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678784 00000100:00100000:1.0:1784938048.657837:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678784 00000100:00100000:1.0:1784938048.657911:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:1.0:1784938048.657924:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048678784:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938048.657947:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938048.657971:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991000/0xea86628a8aec36eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8977c2 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.658008:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991000/0xea86628a8aec36eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c2 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.658032:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991000/0xea86628a8aec36eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c2 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938048.658043:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991000, rc 0) 00000100:00100000:1.0:1784938048.658139:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048678784:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 217us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938048.658148:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:1.0:1784938048.665602:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938048.666959:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048678912 00000100:00100000:3.0:1784938048.666978:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048678912 00000100:00100000:3.0:1784938048.667077:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:3.0:1784938048.667089:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048678912:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938048.667509:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048678912:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 421us (1922us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938048.667518:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:3.0:1784938049.074075:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938049.074119:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065478656:192.168.201.158@tcp:13: 00000100:00100000:3.0:1784938049.074505:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938049.075590:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478656 00000100:00100000:2.0:1784938049.075605:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478656 00000100:00100000:2.0:1784938049.076079:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00080000:0.0:1784938049.076194:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938049.077286:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065478656:12345-192.168.201.158@tcp:13: 00002000:00000024:2.0:1784938049.077360:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938049.078322:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065478656:12345-192.168.201.158@tcp:13: Request processed in 2225us (3810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938049.078337:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 14 00010000:00080000:1.0:1784938049.082597:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52bb480 x1871643065478656/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938049.082887:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065478656:192.168.201.158@tcp:13: 00010000:00010000:2.0:1784938049.396669:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784938050.161354:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1784938050.161366:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac7f16000 from 39 10000000:01000000:0.0:1784938050.161373:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938050.161462:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.161477:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.161491:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938050.161524:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065478784:0@lo:101: 00000100:00100000:0.0:1784938050.161648:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.161857:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938050.161927:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478784 00000100:00100000:1.0:1784938050.161945:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478784 00000100:00100000:1.0:1784938050.162040:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1784938050.162051:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+12:5802:x1871643065478784:12345-0@lo:101: 00010000:00010000:1.0:1784938050.162068:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938050.162096:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990a00/0xea86628a8aec36f9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec36f2 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938050.162127:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990a00/0xea86628a8aec36f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec36f2 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938050.162140:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990a00/0xea86628a8aec36f9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec36f2 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938050.162151:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990a00, rc 0) 00000100:00100000:1.0:1784938050.162209:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065478784:12345-0@lo:101: Request processed in 159us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938050.162248:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1784938050.162824:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065478784:0@lo:101: 00010000:00010000:0.0:1784938050.162845:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.162855:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938050.162932:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065478912:0@lo:501: 00000100:00100000:0.0:1784938050.162973:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.163014:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.163066:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065478912 00000100:00100000:3.0:1784938050.163078:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065478912 00000100:00100000:3.0:1784938050.163114:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784938050.163122:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065478912:12345-0@lo:501: 00000100:00100000:3.0:1784938050.163490:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065478912:12345-0@lo:501: Request processed in 369us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.163496:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1784938050.163525:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065478912:0@lo:501: 00000100:00100000:3.0:1784938050.163547:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479040:0@lo:503: 00000100:00100000:3.0:1784938050.163580:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.163591:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac3427840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.163602:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479040 00000100:00100000:3.0:1784938050.163605:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479040 00000100:00100000:3.0:1784938050.163621:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784938050.163626:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065479040:12345-0@lo:503: 00000100:00100000:3.0:1784938050.163803:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065479040:12345-0@lo:503: Request processed in 175us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.163809:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1784938050.163846:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479040:0@lo:503: 00000100:00100000:3.0:1784938050.164084:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8333:1871643065479168:0@lo:502: 00000100:00100000:3.0:1784938050.164118:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.164137:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479168 00000100:00100000:3.0:1784938050.164140:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479168 00000100:00100000:3.0:1784938050.164161:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784938050.164167:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:8333:x1871643065479168:12345-0@lo:502: 00000100:00100000:3.0:1784938050.164350:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:8333:x1871643065479168:12345-0@lo:502: Request processed in 182us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.164357:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1784938050.164948:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.164974:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8333:1871643065479168:0@lo:502: 00000100:00100000:3.0:1784938050.165035:0:8333:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8333:1871643065479296:0@lo:502: 00000100:00100000:3.0:1784938050.165136:0:8333:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.165206:0:8333:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938050.165288:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479296 00000100:00100000:0.0:1784938050.165295:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479296 00000100:00100000:0.0:1784938050.165387:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1784938050.165406:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:8333:x1871643065479296:12345-0@lo:502: 00000100:00100000:0.0:1784938050.165628:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:8333:x1871643065479296:12345-0@lo:502: Request processed in 232us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938050.165635:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1784938050.165835:0:8333:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8333:1871643065479296:0@lo:502: 00000040:00080000:3.0:1784938050.165859:0:8333:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784938050.165944:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784938050.165970:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938050.165982:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166008:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938050.166019:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1784938050.166022:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1784938050.166026:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1784938050.166057:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166065:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166086:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.166100:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479424:0@lo:101: 00000100:00100000:3.0:1784938050.166132:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.166164:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.166180:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479424 00000100:00100000:3.0:1784938050.166184:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479424 00000100:00100000:3.0:1784938050.166206:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784938050.166238:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+13:5802:x1871643065479424:12345-0@lo:101: 00010000:00010000:3.0:1784938050.166249:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938050.166266:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3707 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3700 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166291:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3700 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166304:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3707 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3700 expref: 14 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166315:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11bc00, rc 0) 00000100:00100000:3.0:1784938050.166347:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065479424:12345-0@lo:101: Request processed in 133us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.166353:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1784938050.166383:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479424:0@lo:101: 00010000:00010000:3.0:1784938050.166408:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.166418:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.166463:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479552:0@lo:501: 00000100:00100000:3.0:1784938050.166486:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.166498:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.166515:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479552 00000100:00100000:3.0:1784938050.166518:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479552 00000100:00100000:3.0:1784938050.166533:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784938050.166538:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065479552:12345-0@lo:501: 00000100:00100000:3.0:1784938050.166793:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065479552:12345-0@lo:501: Request processed in 253us (305us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.166799:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1784938050.166827:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479552:0@lo:501: 00000100:00100000:3.0:1784938050.166851:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479680:0@lo:503: 00000100:00100000:3.0:1784938050.166887:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.166900:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.166913:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479680 00000100:00100000:3.0:1784938050.166917:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479680 00000100:00100000:3.0:1784938050.166935:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784938050.166941:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065479680:12345-0@lo:503: 00000100:00100000:3.0:1784938050.167110:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065479680:12345-0@lo:503: Request processed in 168us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.167117:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1784938050.167152:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065479680:0@lo:503: 00000100:00100000:2.0:1784938050.167918:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8334:1871643065479808:0@lo:502: 00000100:00100000:2.0:1784938050.167972:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.168044:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.168135:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479808 00000100:00100000:3.0:1784938050.168142:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479808 00000100:00100000:3.0:1784938050.168211:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1784938050.168248:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:8334:x1871643065479808:12345-0@lo:502: 00000100:00100000:3.0:1784938050.168461:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:8334:x1871643065479808:12345-0@lo:502: Request processed in 213us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.168470:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1784938050.168681:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8334:1871643065479808:0@lo:502: 00000020:01000000:0.0:1784938050.168711:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938050.168724:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938050.168727:0:8334:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938050.168733:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1784938050.168760:0:8334:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8334:1871643065479936:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938050.168800:0:8334:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.169020:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065479936 00000100:00100000:2.0:1784938050.169026:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065479936 00000100:00100000:2.0:1784938050.169053:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1784938050.169060:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:8334:x1871643065479936:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938050.169245:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:8334:x1871643065479936:12345-0@lo:502:llog_process_th.0 Request processed in 184us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.169261:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1784938050.169532:0:8334:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938050.169556:0:8334:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8334:1871643065479936:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938050.169578:0:8334:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938050.169583:0:8334:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938050.169585:0:8334:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938050.169589:0:8334:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1784938050.169852:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1784938050.169876:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784938050.169890:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.169903:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938050.169913:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784938050.169916:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac73fb000 from 39 10000000:01000000:3.0:1784938050.169919:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938050.169953:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.169961:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.169971:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.170001:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.170051:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.170171:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22fe40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.170211:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480064 00000100:00100000:2.0:1784938050.170322:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480064 00000100:00100000:2.0:1784938050.170392:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1784938050.170680:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:5802:x1871643065480064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938050.170696:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938050.170713:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893800/0xea86628a8aec3715 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec370e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.170743:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893800/0xea86628a8aec3715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec370e expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.170755:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893800/0xea86628a8aec3715 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec370e expref: 15 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.170767:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893800, rc 0) 00000100:00100000:2.0:1784938050.170820:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065480064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.170827:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1784938050.170893:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938050.170908:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.170917:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938050.170977:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938050.171019:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.171291:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.171337:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480192 00000100:00100000:3.0:1784938050.171344:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480192 00000100:00100000:3.0:1784938050.171371:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784938050.171382:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065480192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.172034:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065480192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 654us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.172043:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1784938050.172263:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.172309:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.172356:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.172373:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.172387:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480320 00000100:00100000:3.0:1784938050.172391:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480320 00000100:00100000:3.0:1784938050.172426:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784938050.172434:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065480320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.172600:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065480320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.172607:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1784938050.172646:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.173030:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8336:1871643065480448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.173191:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.173236:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480448 00000100:00100000:3.0:1784938050.173240:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480448 00000100:00100000:3.0:1784938050.173261:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784938050.173268:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:8336:x1871643065480448:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.173462:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:8336:x1871643065480448:12345-0@lo:502:llog_process_th.0 Request processed in 193us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.173469:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1784938050.173509:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.173522:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8336:1871643065480448:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.173561:0:8336:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8336:1871643065480576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.173601:0:8336:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.173619:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480576 00000100:00100000:3.0:1784938050.173623:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480576 00000100:00100000:3.0:1784938050.173641:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784938050.173646:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:8336:x1871643065480576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.173838:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:8336:x1871643065480576:12345-0@lo:502:llog_process_th.0 Request processed in 191us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.173845:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1784938050.173874:0:8336:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.173886:0:8336:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8336:1871643065480576:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1784938050.173905:0:8336:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1784938050.173981:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1784938050.174386:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1784938050.174399:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174410:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938050.174421:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1784938050.174424:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1784938050.174427:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938050.174460:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174468:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174490:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.174507:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.174543:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.174561:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.174580:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480704 00000100:00100000:3.0:1784938050.174585:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480704 00000100:00100000:3.0:1784938050.174607:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784938050.174614:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:5802:x1871643065480704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938050.174624:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938050.174640:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec3723 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec371c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174817:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec3723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec371c expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174831:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec3723 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec371c expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174841:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11ba00, rc 0) 00000100:00100000:3.0:1784938050.174874:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065480704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.174880:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1784938050.174918:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938050.174933:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.174948:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.175021:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.175048:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.175253:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480832 00000100:00100000:2.0:1784938050.175259:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480832 00000100:00100000:2.0:1784938050.175288:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1784938050.175296:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065480832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.175601:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065480832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 305us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.175609:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1784938050.175965:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22f900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.175987:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.176042:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.176252:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.176289:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22f900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.176610:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065480960 00000100:00100000:2.0:1784938050.176623:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065480960 00000100:00100000:2.0:1784938050.176814:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1784938050.176823:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065480960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.177060:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065480960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 236us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.177068:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1784938050.177862:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065480960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.178186:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8337:1871643065481088:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.178265:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.178298:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481088 00000100:00100000:3.0:1784938050.178304:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481088 00000100:00100000:3.0:1784938050.178336:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784938050.178343:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:8337:x1871643065481088:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.178803:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:8337:x1871643065481088:12345-0@lo:502:llog_process_th.0 Request processed in 458us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.178813:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1784938050.178874:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.178891:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8337:1871643065481088:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938050.178917:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938050.178934:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938050.178937:0:8337:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1784938050.178942:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1784938050.178968:0:8337:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8337:1871643065481216:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.179012:0:8337:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.179036:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481216 00000100:00100000:3.0:1784938050.179040:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481216 00000100:00100000:3.0:1784938050.179059:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784938050.179065:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:8337:x1871643065481216:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.179279:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:8337:x1871643065481216:12345-0@lo:502:llog_process_th.0 Request processed in 213us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.179286:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1784938050.179312:0:8337:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.179326:0:8337:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8337:1871643065481216:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938050.179343:0:8337:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938050.179347:0:8337:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938050.179349:0:8337:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1784938050.179353:0:8337:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1784938050.179782:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1784938050.179807:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784938050.179820:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.179832:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938050.179843:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1784938050.179846:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05ac735f800 from 39 10000000:01000000:3.0:1784938050.179850:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1784938050.179890:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.179898:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.179908:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.179923:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.179960:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.179977:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee22fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.180007:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481344 00000100:00100000:3.0:1784938050.180012:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481344 00000100:00100000:3.0:1784938050.180052:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1784938050.180059:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065481344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938050.180364:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938050.180383:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11b600/0xea86628a8aec3731 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec372a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.180490:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11b600/0xea86628a8aec3731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec372a expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.180504:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11b600/0xea86628a8aec3731 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec372a expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938050.180515:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b600, rc 0) 00000100:00100000:3.0:1784938050.180599:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065481344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 539us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.180606:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1784938050.180749:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938050.180765:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.180774:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938050.180830:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.180864:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.180926:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.180962:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481472 00000100:00100000:3.0:1784938050.180968:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481472 00000100:00100000:3.0:1784938050.181007:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1784938050.181014:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065481472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.181756:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065481472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 740us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.181765:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1784938050.181843:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.181880:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.181927:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.181982:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.182026:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481600 00000100:00100000:3.0:1784938050.182034:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481600 00000100:00100000:3.0:1784938050.182175:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1784938050.182184:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065481600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.182587:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065481600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 403us (658us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.182594:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1784938050.182657:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.183482:0:8338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8338:1871643065481728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.183545:0:8338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.183619:0:8338:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.183656:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481728 00000100:00100000:2.0:1784938050.183735:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481728 00000100:00100000:2.0:1784938050.183816:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1784938050.183826:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8338:x1871643065481728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938050.184116:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8338:x1871643065481728:12345-0@lo:502:llog_process_th.0 Request processed in 290us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.184123:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1784938050.184204:0:8338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8338:1871643065481728:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.184282:0:8338:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8338:1871643065481856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.184319:0:8338:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.184603:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481856 00000100:00100000:0.0:1784938050.184609:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481856 00000100:00100000:0.0:1784938050.184639:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1784938050.184646:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8338:x1871643065481856:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938050.184922:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8338:x1871643065481856:12345-0@lo:502:llog_process_th.0 Request processed in 275us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938050.184929:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1784938050.185272:0:8338:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68dec00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.185291:0:8338:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8338:1871643065481856:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1784938050.185319:0:8338:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784938050.185749:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1784938050.185771:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938050.185784:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.185796:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938050.185817:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1784938050.185819:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1784938050.185822:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1784938050.185860:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.185868:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.185879:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938050.185897:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938050.185940:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.185972:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86a80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.186025:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065481984 00000100:00100000:2.0:1784938050.186032:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065481984 00000100:00100000:2.0:1784938050.186086:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784938050.186096:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065481984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938050.186112:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938050.186130:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893600/0xea86628a8aec373f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3738 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.186160:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893600/0xea86628a8aec373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3738 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.186173:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893600/0xea86628a8aec373f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3738 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.186185:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893600, rc 0) 00000100:00100000:2.0:1784938050.186299:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065481984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.186306:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1784938050.186853:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065481984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938050.186869:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.186888:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938050.186951:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.186985:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.187055:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938050.187141:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482112 00000100:00100000:0.0:1784938050.187147:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482112 00000100:00100000:0.0:1784938050.187238:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1784938050.187247:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065482112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938050.187548:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065482112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 302us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938050.187556:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1784938050.187708:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.187745:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.187788:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938050.187945:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68def00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.187974:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482240 00000100:00100000:2.0:1784938050.187979:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482240 00000100:00100000:2.0:1784938050.188012:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1784938050.188020:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065482240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938050.188203:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065482240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.188210:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1784938050.188484:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938050.189629:0:8339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8339:1871643065482368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938050.189796:0:8339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.189949:0:8339:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.189988:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482368 00000100:00100000:3.0:1784938050.190005:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482368 00000100:00100000:3.0:1784938050.190159:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1784938050.190170:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8339:x1871643065482368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938050.190849:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8339:x1871643065482368:12345-0@lo:502:llog_process_th.0 Request processed in 677us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938050.190859:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1784938050.190953:0:8339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8339:1871643065482368:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938050.191002:0:8339:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938050.191015:0:8339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938050.191018:0:8339:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784938050.191025:0:8339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784938050.191058:0:8339:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8339:1871643065482496:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938050.191111:0:8339:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938050.191401:0:8339:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938050.191524:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482496 00000100:00100000:0.0:1784938050.191531:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482496 00000100:00100000:0.0:1784938050.191573:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1784938050.191581:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8339:x1871643065482496:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938050.191865:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8339:x1871643065482496:12345-0@lo:502:llog_process_th.0 Request processed in 283us (752us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938050.191872:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1784938050.191966:0:8339:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8339:1871643065482496:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938050.191999:0:8339:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938050.192004:0:8339:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938050.192006:0:8339:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784938050.192015:0:8339:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1784938050.192333:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:0.0:1784938050.192354:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1784938050.192367:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.192572:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938050.192585:0:5802:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1784938050.192589:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa05ae17299c0 from 1 10000000:01000000:0.0:1784938050.192592:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1784938050.192630:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.192640:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.192652:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938050.192748:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938050.192796:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.192831:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac6351180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938050.192886:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482624 00000100:00100000:2.0:1784938050.192894:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482624 00000100:00100000:2.0:1784938050.192924:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1784938050.192933:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065482624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938050.192948:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938050.192965:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893c00/0xea86628a8aec374d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3746 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.196832:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893c00/0xea86628a8aec374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3746 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.196866:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893c00/0xea86628a8aec374d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3746 expref: 19 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938050.196971:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893c00, rc 0) 00000100:00100000:2.0:1784938050.197277:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065482624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4341us (4478us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938050.197288:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1784938050.197817:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938050.197853:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.197867:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938050.198799:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938050.198874:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938050.198937:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac6351180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938050.199317:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482752 00000100:00100000:3.0:1784938050.199328:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482752 00000100:00100000:3.0:1784938050.200239:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1784938050.200257:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065482752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938050.205066:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065482752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4800us (6176us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938050.205826:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065482752:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1784938050.205891:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1784938050.205907:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938050.205923:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938050.206068:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00010000:1.0:1784938050.418509:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938051.121560:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938051.124126:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065483008:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938051.128593:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938051.128633:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483008 00000100:00100000:2.0:1784938051.128656:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483008 00000100:00100000:2.0:1784938051.128720:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00100000:2.0:1784938051.128731:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065483008:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938051.128823:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065483008:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938051.128831:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00100000:1.0:1784938051.129179:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065483008:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938051.129249:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065482880:0@lo:400:kworker.0 00000100:00100000:1.0:1784938051.129305:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938051.129664:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065482880 00000100:00100000:2.0:1784938051.129688:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065482880 00000100:00100000:2.0:1784938051.129737:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1784938051.129745:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065482880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938051.129793:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065482880:12345-0@lo:400:kworker.0 Request processed in 49us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938051.129799:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1784938051.130485:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065482880:0@lo:400:kworker.0 00000100:00100000:0.0:1784938051.132277:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065483392:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.132395:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938051.132403:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065483520:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.132453:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065483136:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.132482:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938051.132488:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065483264:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.132756:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938051.132836:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938051.132895:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938051.132920:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938051.132952:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483392 00000100:00100000:0.0:1784938051.132962:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483392 00000100:00100000:0.0:1784938051.133039:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483136 00000100:00100000:0.0:1784938051.133043:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483136 00000100:00100000:0.0:1784938051.133071:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 29 00000100:00100000:0.0:1784938051.133081:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065483392:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.133140:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065483392:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 60us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938051.133149:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 29 00000100:00100000:0.0:1784938051.133167:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 30 00000100:00100000:0.0:1784938051.133175:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065483136:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.133197:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065483136:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938051.133203:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 30 00000100:00100000:0.0:1784938051.133252:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483520 00000100:00100000:0.0:1784938051.133257:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483520 00000100:00100000:0.0:1784938051.133284:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483264 00000100:00100000:0.0:1784938051.133288:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483264 00000100:00100000:0.0:1784938051.133309:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:0.0:1784938051.133315:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065483520:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.133343:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065483520:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938051.133349:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:0.0:1784938051.133361:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:0.0:1784938051.133367:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065483264:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.133400:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065483264:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938051.133406:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00080000:0.0:1784938051.133428:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938051.133432:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938051.133435:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1784938051.133623:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05affeb5c00 x1871643065483264/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938051.133639:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065483264:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.133651:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065483136:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938051.133685:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05affeb7100 x1871643065483520/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938067 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938051.133694:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065483520:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938051.133703:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065483392:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938051.441848:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938051.467650:0:8371:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec3576610 20000000:00000080:1.0:1784938051.467676:0:8371:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa05b01ce3c00 uarg=0000000000000000 20000000:01000000:1.0:1784938051.467720:0:8371:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938051.467734:0:8371:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938051.467741:0:8371:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1784938051.468732:0:8372:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:3.0:1784938051.468897:0:8371:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1784938051.476492:0:8371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1784938051.476560:0:8371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1784938051.476628:0:8371:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1784938051.476651:0:8371:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784938051.476679:0:8371:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476701:0:8371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476709:0:8371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3524 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476716:0:8371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec35ef expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476728:0:8371:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476737:0:8371:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476793:0:8371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.476833:0:8371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 9 pid: 5799 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938051.476853:0:8371:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065483648:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938051.477027:0:8371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec35ef expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477036:0:8371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec35ef expref: 18 pid: 5797 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938051.477046:0:8371:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065483776:0@lo:104: 00000100:00100000:2.0:1784938051.477099:0:8371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938051.477144:0:8371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3524 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477153:0:8371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3524 expref: 18 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938051.477162:0:8371:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065483904:0@lo:104: 00000100:00100000:2.0:1784938051.477186:0:8371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938051.477265:0:5789:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1784938051.477281:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483776 00000100:00100000:2.0:1784938051.477290:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483776 00000100:00100000:2.0:1784938051.477338:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065483904 00000100:00100000:2.0:1784938051.477341:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065483904 00000100:00100000:2.0:1784938051.477357:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938051.477366:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:8371:x1871643065483776:12345-0@lo:104: 00010000:00010000:2.0:1784938051.477382:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477444:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938051.477450:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:8371:x1871643065483776:12345-0@lo:104: Request processed in 85us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938051.477456:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938051.477473:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1784938051.477479:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8371:x1871643065483904:12345-0@lo:104: 00010000:00010000:2.0:1784938051.477487:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477520:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1784938051.477524:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff8c4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8371:x1871643065483904:12345-0@lo:104: Request processed in 46us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938051.477529:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1784938051.477571:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938051.477577:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477586:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938051.477590:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477599:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938051.477607:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938051.477613:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938051.477655:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477662:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938051.477683:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477690:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac8991800/0xea86628a8aec35ef lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec35f6 expref: -99 pid: 7491 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477704:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938051.477708:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477713:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1480e00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938051.477715:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477721:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938051.477726:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938051.477731:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938051.477743:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477749:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938051.477754:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477771:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac1480e00/0xea86628a8aec3524 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec352b expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477782:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938051.477784:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938051.477785:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938051.477816:0:8371:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 18 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477826:0:8371:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 18 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938051.477835:0:8371:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065484288:0@lo:104: 00000100:00100000:2.0:1784938051.477860:0:8371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938051.477881:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484288 00000100:00100000:2.0:1784938051.477885:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484288 00000100:00100000:2.0:1784938051.477902:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1784938051.477908:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8371:x1871643065484288:12345-0@lo:104: 00010000:00010000:2.0:1784938051.477916:0:5789:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.477947:0:5789:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1784938051.477953:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:8371:x1871643065484288:12345-0@lo:104: Request processed in 46us (93us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938051.477959:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:2.0:1784938051.477987:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938051.477991:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.478007:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938051.478010:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.478017:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938051.478023:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938051.478028:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938051.478042:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.478048:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938051.478062:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.478068:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11b000/0xea86628a8aec34c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec34c9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.478083:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938051.478085:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938051.478086:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938051.478100:0:8371:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef60c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938051.478130:0:8371:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065483776:0@lo:104: 00000100:00100000:2.0:1784938051.478138:0:8371:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065483904:0@lo:104: 00000100:00100000:2.0:1784938051.478144:0:8371:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065484288:0@lo:104: 00010000:00010000:1.0:1784938051.478342:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938051.478354:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938051.478367:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065484416:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938051.478405:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938051.478677:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065484032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938051.478710:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938051.478741:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938051.478746:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065484160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938051.478766:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938051.478846:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484416 00000100:00100000:1.0:1784938051.478853:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484416 00010000:00010000:1.0:1784938051.478884:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 19 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938051.478905:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484032 00000100:00100000:1.0:1784938051.478908:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484032 00010000:00010000:1.0:1784938051.478919:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35ef expref: 20 pid: 5797 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938051.478929:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484160 00000100:00100000:1.0:1784938051.478931:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484160 00010000:00010000:1.0:1784938051.478940:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3524 expref: 21 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938051.478952:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784938051.478958:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+21:3324:x1871643065484416:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938051.478981:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938051.478988:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 21 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.478998:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 21 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479029:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030800/0xea86628a8aec34c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec34c2 expref: 21 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479047:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938051.479090:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3324:x1871643065484416:12345-0@lo:103:ldlm_bl.0 Request processed in 130us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938051.479097:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784938051.479115:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784938051.479121:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065484032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938051.479128:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938051.479132:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec35ef expref: 19 pid: 5797 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479141:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec35ef expref: 19 pid: 5797 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479149:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892800/0xea86628a8aec35f6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec35ef expref: 19 pid: 5797 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479159:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938051.479185:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:3321:x1871643065484032:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938051.479191:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1784938051.479203:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1784938051.479208:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:3321:x1871643065484160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938051.479394:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938051.479400:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3524 expref: 17 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479413:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3524 expref: 17 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479422:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893a00/0xea86628a8aec352b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3524 expref: 17 pid: 5798 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.479430:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938051.479455:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3321:x1871643065484160:12345-0@lo:103:ldlm_bl.0 Request processed in 246us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938051.479461:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938051.479688:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065484416:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938051.479723:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065484160:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938051.479730:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065484032:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938051.481996:0:8371:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8371:1871643065483648:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938051.482049:0:8371:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938051.488431:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938051.489110:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679040 00000100:00100000:1.0:1784938051.489126:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679040 00010000:00010000:1.0:1784938051.489189:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 10 pid: 5799 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938051.489254:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1784938051.489263:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784938051.489270:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2356:x1871643048679040:12345-192.168.201.58@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1784938051.489275:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:1.0:1784938051.489292:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938051.489301:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 10 pid: 5799 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489316:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 10 pid: 5799 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489347:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11a400/0xea86628a8aec36b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89778a expref: 10 pid: 5799 timeout: 360 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489371:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489403:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489425:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489432:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489440:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489448:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489454:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938051.489459:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489468:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489483:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938051.489496:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938051.489727:0:8371:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.489737:0:8371:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938051.489743:0:8371:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893e00/0xea86628a8aec3754 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8371 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938051.490487:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+9:2356:x1871643048679040:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1218us (2067us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938051.490498:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1784938051.635523:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938051.635562:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065484544:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938051.635934:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938051.635980:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484544 00000100:00100000:1.0:1784938051.635990:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484544 00000100:00100000:1.0:1784938051.636039:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00100000:1.0:1784938051.636130:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065484544:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938051.636173:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938051.636289:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065484544:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 241us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938051.636297:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 15 00010000:00080000:0.0:1784938051.638763:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb3480 x1871643065484544/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938051.638788:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065484544:192.168.201.158@tcp:13:osp-pre-1-0.0 10000000:01000000:3.0:1784938052.211732:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938052.211744:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac7f16000 from 4 10000000:01000000:3.0:1784938052.211753:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938052.211821:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.211836:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.211864:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938052.211917:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065484672:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.212143:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.212207:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.212262:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484672 00000100:00100000:3.0:1784938052.212271:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484672 00000100:00100000:3.0:1784938052.212339:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784938052.212349:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065484672:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938052.212368:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938052.212388:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec375b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.212421:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec375b expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.212435:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec375b expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.212447:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:3.0:1784938052.212495:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065484672:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.212503:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1784938052.212912:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065484672:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938052.212936:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.212947:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938052.213262:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065484800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.213308:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.213351:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938052.213567:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484800 00000100:00100000:2.0:1784938052.213575:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484800 00000100:00100000:2.0:1784938052.213749:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784938052.213759:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065484800:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.214135:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065484800:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 377us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938052.214144:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1784938052.214254:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065484800:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.214305:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065484928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.214360:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938052.214378:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1090c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938052.214392:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065484928 00000100:00100000:2.0:1784938052.214396:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065484928 00000100:00100000:2.0:1784938052.214421:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784938052.214428:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065484928:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.214602:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065484928:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938052.214610:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1784938052.214652:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065484928:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.217837:0:8388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8388:1871643065485056:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938052.218461:0:8388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.218518:0:8388:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938052.218693:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485056 00000100:00100000:0.0:1784938052.218704:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485056 00000100:00100000:0.0:1784938052.218769:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1784938052.218780:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8388:x1871643065485056:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938052.219740:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8388:x1871643065485056:12345-0@lo:502:llog_process_th.0 Request processed in 956us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938052.219750:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1784938052.220295:0:8388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8388:1871643065485056:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938052.220337:0:8388:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938052.220349:0:8388:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938052.220352:0:8388:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938052.220358:0:8388:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05ac7f16000 00000020:00000080:3.0:1784938052.220361:0:8388:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784938052.221051:0:8388:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8388:1871643065485184:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938052.221130:0:8388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938052.221236:0:8388:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938052.221415:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485184 00000100:00100000:1.0:1784938052.221424:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485184 00000100:00100000:2.0:1784938052.222119:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784938052.222129:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8388:x1871643065485184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938052.222439:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:8388:x1871643065485184:12345-0@lo:502:llog_process_th.0 Request processed in 309us (1307us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938052.222449:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1784938052.222524:0:8388:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8388:1871643065485184:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938052.222556:0:8388:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938052.222564:0:8388:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938052.222566:0:8388:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1784938052.222571:0:8388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1784938052.222745:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1784938052.222767:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938052.222779:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938052.222793:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938052.222804:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1784938052.222812:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac73fb000 from 4 10000000:01000000:2.0:1784938052.222815:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938052.222854:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938052.222863:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938052.222873:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938052.222893:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485312:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.222927:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938052.222968:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485312 00000100:00100000:0.0:1784938052.222974:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485312 00000100:00100000:2.0:1784938052.222976:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938052.223004:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1784938052.223011:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065485312:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938052.223024:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938052.223039:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3769 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938052.223063:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3769 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938052.223076:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3769 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938052.223086:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05b021ee200, rc 0) 00000100:00100000:0.0:1784938052.223126:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065485312:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938052.223138:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1784938052.223197:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485312:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938052.223211:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938052.223252:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938052.223298:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.223323:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938052.223341:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938052.223353:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485440 00000100:00100000:2.0:1784938052.223356:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485440 00000100:00100000:2.0:1784938052.223376:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784938052.223381:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065485440:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.223712:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065485440:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938052.223726:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1784938052.223768:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485440:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.223798:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938052.223833:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938052.223854:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938052.224800:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485568 00000100:00100000:0.0:1784938052.224813:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485568 00000100:00100000:0.0:1784938052.224931:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1784938052.224942:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065485568:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938052.225306:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065485568:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 364us (1470us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938052.225324:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1784938052.225713:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485568:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.227880:0:8391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8391:1871643065485696:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938052.227991:0:8391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.228049:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485696 00000100:00100000:3.0:1784938052.228058:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485696 00000100:00100000:3.0:1784938052.228115:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784938052.228125:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8391:x1871643065485696:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938052.228484:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8391:x1871643065485696:12345-0@lo:502:llog_process_th.0 Request processed in 358us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.228493:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1784938052.228575:0:8391:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.231089:0:8391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8391:1871643065485696:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938052.231154:0:8391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938052.231169:0:8391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938052.231172:0:8391:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938052.231180:0:8391:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05ac73fb000 00000020:00000080:3.0:1784938052.231183:0:8391:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1784938052.231318:0:8391:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8391:1871643065485824:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938052.231405:0:8391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.231452:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485824 00000100:00100000:3.0:1784938052.231459:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485824 00000100:00100000:3.0:1784938052.231513:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784938052.231523:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8391:x1871643065485824:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938052.231771:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:8391:x1871643065485824:12345-0@lo:502:llog_process_th.0 Request processed in 249us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.231780:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1784938052.231837:0:8391:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.232653:0:8391:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8391:1871643065485824:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1784938052.232708:0:8391:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938052.232715:0:8391:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938052.232717:0:8391:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1784938052.232721:0:8391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1784938052.232996:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1784938052.233031:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938052.233046:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938052.233058:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938052.233075:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1784938052.233078:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac735f800 from 4 10000000:01000000:1.0:1784938052.233081:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1784938052.233436:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938052.233446:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938052.233470:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938052.233493:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1784938052.233559:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938052.233595:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac50f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.234289:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065485952 00000100:00100000:3.0:1784938052.234299:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065485952 00000100:00100000:3.0:1784938052.234359:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1784938052.234369:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065485952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938052.234387:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938052.234404:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3777 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.234443:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3777 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.234455:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3777 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.234466:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:3.0:1784938052.234513:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065485952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (955us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.234520:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1784938052.235033:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065485952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938052.235053:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938052.235064:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938052.235143:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065486080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938052.235185:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938052.235238:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac50f9840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.235267:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486080 00000100:00100000:3.0:1784938052.235273:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486080 00000100:00100000:3.0:1784938052.235317:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784938052.235326:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065486080:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.236111:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065486080:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 782us (923us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.236122:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1784938052.236429:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065486080:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.236479:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065486208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.236536:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.236570:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.236588:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486208 00000100:00100000:3.0:1784938052.236720:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486208 00000100:00100000:3.0:1784938052.236764:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784938052.236775:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065486208:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938052.237001:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065486208:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.237008:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1784938052.237850:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065486208:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938052.239985:0:8393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8393:1871643065486336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938052.241805:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938052.241877:0:8393:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affec9480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938052.242018:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486336 00000100:00100000:1.0:1784938052.242031:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486336 00000100:00100000:1.0:1784938052.242109:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1784938052.242120:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:8393:x1871643065486336:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938052.242435:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:8393:x1871643065486336:12345-0@lo:502:llog_process_th.0 Request processed in 316us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938052.242443:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1784938052.242670:0:8393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8393:1871643065486336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938052.242714:0:8393:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938052.242728:0:8393:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938052.242731:0:8393:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784938052.242742:0:8393:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05ac735f800 00000020:00000080:0.0:1784938052.242746:0:8393:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784938052.243759:0:8393:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8393:1871643065486464:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938052.243823:0:8393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938052.243867:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486464 00000100:00100000:0.0:1784938052.243872:0:8393:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affec9480 going to sleep for 11 seconds 00000100:00100000:3.0:1784938052.243878:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486464 00000100:00100000:3.0:1784938052.243941:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1784938052.243953:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:8393:x1871643065486464:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938052.244946:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:8393:x1871643065486464:12345-0@lo:502:llog_process_th.0 Request processed in 988us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.244968:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1784938052.245015:0:8393:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:8393:1871643065486464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938052.245053:0:8393:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938052.245062:0:8393:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938052.245065:0:8393:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1784938052.245071:0:8393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1784938052.245602:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1784938052.245706:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938052.245721:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.245733:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938052.466802:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938052.981372:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938052.981754:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679168 00000100:00100000:3.0:1784938052.981765:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679168 00000100:00100000:3.0:1784938052.981820:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:3.0:1784938052.981830:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+9:5573:x1871643048679168:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938052.981848:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938052.981869:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8977c9 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.981915:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.981928:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938052.981937:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c800, rc 0) 00000100:00100000:3.0:1784938052.982006:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048679168:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 176us (643us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938052.982013:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:2.0:1784938052.997993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938052.998079:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679296 00000100:00100000:0.0:1784938052.998088:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679296 00000100:00100000:0.0:1784938052.998145:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:0.0:1784938052.998155:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048679296:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938052.998481:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048679296:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 326us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938052.998490:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:1.0:1784938053.010756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938053.012145:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679424 00000100:00100000:3.0:1784938053.012159:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679424 00000100:00100000:3.0:1784938053.012240:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:3.0:1784938053.012251:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048679424:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938053.012536:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:5573:x1871643048679424:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 287us (1790us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938053.012552:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:1.0:1784938053.050027:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938053.052688:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679552 00000100:00100000:2.0:1784938053.052704:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679552 00000100:00100000:2.0:1784938053.052770:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:2.0:1784938053.052781:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:6099:x1871643048679552:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938053.053061:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:6099:x1871643048679552:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 280us (3042us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938053.053071:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:0.0:1784938053.070398:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938053.070434:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938053.070469:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938053.070498:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938053.070528:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679936 00000100:00100000:0.0:1784938053.070540:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679936 00000100:00100000:2.0:1784938053.070691:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679808 00000100:00100000:2.0:1784938053.070695:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679808 00000100:00100000:2.0:1784938053.070766:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1784938053.070777:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048679808:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938053.070853:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048679808:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938053.070860:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00080000:2.0:1784938053.070883:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938053.071253:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048679680 00000100:00100000:3.0:1784938053.071259:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048679680 00000100:00100000:3.0:1784938053.071292:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:3.0:1784938053.071300:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:6099:x1871643048679680:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938053.071452:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680064 00000100:00100000:0.0:1784938053.071457:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680064 00000100:00100000:0.0:1784938053.071478:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938053.071485:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048679936:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938053.071524:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048679936:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938053.071531:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938053.071544:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784938053.071551:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048680064:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938053.071821:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:6099:x1871643048679680:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 520us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938053.071829:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:0.0:1784938053.072522:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048680064:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 970us (2021us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938053.072531:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00080000:2.0:1784938053.072767:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938053.072772:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784938053.493142:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938054.202697:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065486592:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938054.203026:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938054.203060:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486592 00000100:00100000:1.0:1784938054.203068:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486592 00000100:00100000:1.0:1784938054.203127:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00100000:1.0:1784938054.203137:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065486592:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938054.203176:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938054.203244:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065486592:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 108us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938054.203252:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00080000:1.0:1784938054.203275:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938054.203403:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb3480 x1871643065486592/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938054.203423:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065486592:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938054.513364:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938055.537734:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938056.241817:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938056.241936:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065486848:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.242096:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938056.242103:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065486976:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.242375:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938056.242479:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938056.242522:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486848 00000100:00100000:3.0:1784938056.242530:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486848 00000100:00100000:0.0:1784938056.242651:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938056.242665:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065487104:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.243792:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486976 00000100:00100000:3.0:1784938056.243802:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486976 00000100:00100000:3.0:1784938056.243851:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 32 00000100:00100000:3.0:1784938056.243863:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065486848:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.243954:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065486848:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 94us (1580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938056.243962:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 32 00000100:00100000:3.0:1784938056.243992:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 33 00000100:00100000:3.0:1784938056.243999:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065486976:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.244020:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065486976:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (1541us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938056.244027:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 33 00000100:00080000:3.0:1784938056.244052:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938056.244396:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938056.244429:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487104 00000100:00100000:3.0:1784938056.244433:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487104 00000100:00100000:3.0:1784938056.244467:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00100000:3.0:1784938056.244474:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065487104:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.244520:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065487104:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 47us (125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938056.244527:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00080000:3.0:1784938056.247141:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784938056.248246:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822d500 x1871643065487104/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938056.248274:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065487104:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.248346:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065486976:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.248360:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065486848:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.249100:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065486720:0@lo:400:kworker.0 00000100:00100000:3.0:1784938056.249186:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938056.249410:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065486720 00000100:00100000:2.0:1784938056.249438:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065486720 00000100:00100000:2.0:1784938056.249506:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1784938056.249516:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065486720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938056.249594:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065486720:12345-0@lo:400:kworker.0 Request processed in 79us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938056.249611:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1784938056.249752:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065486720:0@lo:400:kworker.0 00000100:00100000:0.0:1784938056.250369:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065487232:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938056.250505:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065487360:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938056.250965:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938056.251006:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938056.251032:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487360 00000100:00100000:1.0:1784938056.251039:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487360 00000100:00100000:1.0:1784938056.251100:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:1.0:1784938056.251110:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065487360:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938056.251161:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065487360:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 53us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938056.251168:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00080000:1.0:1784938056.251191:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1784938056.251320:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbf480 x1871643065487360/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938072 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938056.251348:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065487360:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938056.251371:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487232 00000100:00100000:1.0:1784938056.251374:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487232 00000100:00100000:1.0:1784938056.251407:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 34 00000100:00100000:1.0:1784938056.251413:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065487232:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938056.251442:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065487232:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938056.251448:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 34 00000100:00080000:1.0:1784938056.251463:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938056.258940:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065487232:192.168.201.158@tcp:400:kworker.0 00010000:00010000:0.0:1784938056.565058:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938056.758589:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938056.758643:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065487488:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938056.759195:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938056.759253:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487488 00000100:00100000:3.0:1784938056.759263:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487488 00000100:00100000:3.0:1784938056.759320:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:3.0:1784938056.759330:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065487488:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938056.759375:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938056.759423:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065487488:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 94us (230us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938056.759431:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 17 00010000:00080000:0.0:1784938056.759703:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822c380 x1871643065487488/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938056.759725:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065487488:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938057.594280:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938058.169446:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938058.169500:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938058.169528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938058.169557:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938058.169592:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680448 00000100:00100000:1.0:1784938058.169604:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680448 00000100:00100000:1.0:1784938058.169676:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680576 00000100:00100000:1.0:1784938058.169680:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680576 00000100:00100000:1.0:1784938058.169707:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784938058.169718:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048680448:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938058.169817:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048680448:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 100us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938058.169825:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784938058.169846:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938058.169868:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048680576:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938058.169915:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048680576:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 63us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938058.169922:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784938058.170031:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680192 00000100:00100000:0.0:1784938058.170037:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680192 00000100:00100000:0.0:1784938058.170072:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:0.0:1784938058.170080:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048680192:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938058.170107:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048680192:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938058.170114:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00080000:0.0:1784938058.180544:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938058.180560:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938058.181306:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680320 00000100:00100000:1.0:1784938058.181320:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680320 00000100:00100000:1.0:1784938058.181411:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784938058.181424:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048680320:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938058.181513:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048680320:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (11984us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938058.181521:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00080000:0.0:1784938058.181835:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938058.610420:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938059.313373:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938059.313407:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065487616:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938059.313773:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938059.313812:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487616 00000100:00100000:1.0:1784938059.313822:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487616 00000100:00100000:1.0:1784938059.314049:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00100000:1.0:1784938059.314067:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065487616:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938059.314127:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938059.314183:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065487616:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 120us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938059.314191:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00080000:1.0:1784938059.314257:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938059.314380:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822df80 x1871643065487616/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938075 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938059.314403:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065487616:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938059.633365:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938060.602091:0:8671:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1784938060.657797:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938061.361420:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065488128:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.361560:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065487744:0@lo:400:kworker.0 00000100:00100000:0.0:1784938061.361651:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938061.361711:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065488256:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.361793:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065487872:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.361866:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065488384:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.361976:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938061.361983:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065488000:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.362025:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487744 00000100:00100000:0.0:1784938061.362034:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487744 00000100:00100000:0.0:1784938061.362090:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784938061.362100:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065487744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938061.362165:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065487744:12345-0@lo:400:kworker.0 Request processed in 65us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938061.362173:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1784938061.362430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938061.362734:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938061.363747:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938061.363781:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938061.367400:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938061.367442:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488256 00000100:00100000:2.0:1784938061.367454:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488256 00000100:00100000:2.0:1784938061.367535:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065487872 00000100:00100000:2.0:1784938061.367540:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065487872 00000100:00100000:2.0:1784938061.367555:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488000 00000100:00100000:2.0:1784938061.367557:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488000 00000100:00100000:2.0:1784938061.367575:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 36 00000100:00100000:2.0:1784938061.367585:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065488256:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938061.367682:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065488256:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 97us (5253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938061.367690:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 36 00000100:00100000:2.0:1784938061.367712:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 37 00000100:00100000:2.0:1784938061.367718:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065487872:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938061.367745:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065487872:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (4006us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938061.367752:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 37 00000100:00100000:2.0:1784938061.367761:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 38 00000100:00100000:2.0:1784938061.367781:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065488000:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938061.367821:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065488000:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 41us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938061.367829:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 38 00000100:00080000:2.0:1784938061.367847:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938061.368107:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065487744:0@lo:400:kworker.0 00000100:00100000:2.0:1784938061.368127:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065488256:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.370405:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065488000:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938061.370426:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065487872:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938061.372194:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488384 00000100:00100000:3.0:1784938061.372212:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488384 00000100:00100000:2.0:1784938061.373086:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488128 00000100:00100000:2.0:1784938061.373095:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488128 00000100:00100000:2.0:1784938061.373135:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 20 00000100:00100000:2.0:1784938061.373146:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065488384:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938061.373297:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065488384:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 151us (10561us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938061.373308:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 20 00000100:00100000:2.0:1784938061.373328:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00100000:2.0:1784938061.373335:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065488128:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938061.373362:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065488128:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (9580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938061.373368:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00080000:2.0:1784938061.373389:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938061.373393:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1784938061.376696:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbf100 x1871643065488384/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938061.376723:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065488384:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938061.379416:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbed80 x1871643065488128/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938077 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938061.379441:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065488128:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938061.682390:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938061.881096:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065488512:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938061.881833:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938061.882012:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488512 00000100:00100000:3.0:1784938061.882023:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488512 00000100:00100000:3.0:1784938061.882099:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 19 00000100:00100000:3.0:1784938061.882111:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065488512:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938061.882166:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938061.882271:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065488512:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 161us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938061.882279:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 19 00010000:00080000:3.0:1784938061.882575:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822df80 x1871643065488512/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938077 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938061.882601:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065488512:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:3.0:1784938062.708585:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938063.297600:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938063.297655:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938063.297725:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680704 00000100:00100000:0.0:1784938063.297738:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680704 00000100:00100000:0.0:1784938063.297823:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:0.0:1784938063.297836:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048680704:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938063.297931:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048680704:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 98us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938063.297940:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:1.0:1784938063.298802:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680832 00000100:00100000:1.0:1784938063.298812:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680832 00000100:00100000:1.0:1784938063.298885:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1784938063.298894:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048680832:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938063.298949:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048680832:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 56us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938063.298956:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00080000:0.0:1784938063.299992:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938063.312502:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938063.312560:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938063.312597:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048680960 00000100:00100000:0.0:1784938063.312609:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048680960 00000100:00100000:0.0:1784938063.312677:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681088 00000100:00100000:0.0:1784938063.312681:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681088 00000100:00100000:0.0:1784938063.312710:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784938063.312722:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2354:x1871643048680960:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:0.0:1784938063.312780:0:8127:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec36c1 00000100:00080000:0.0:1784938063.312794:0:8127:0:(import.c:65:import_set_state_nolock()) ffffa05ae1721800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938063.312844:0:8127:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1784938063.313459:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784938063.313472:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2354:x1871643048681088:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:1.0:1784938063.313501:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec36c8 00000100:00080000:1.0:1784938063.313509:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ae1723800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938063.313541:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1784938063.314380:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938063.315566:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+2:2354:x1871643048680960:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 2834us (3067us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938063.315582:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00080000:0.0:1784938063.315625:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938063.315632:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938063.315913:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+2:2354:x1871643048681088:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 2443us (3350us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938063.315922:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00010000:00010000:1.0:1784938063.315973:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938063.730303:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938064.442503:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065488640:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938064.442986:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938064.443030:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488640 00000100:00100000:2.0:1784938064.443041:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488640 00000100:00100000:2.0:1784938064.443118:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 20 00000100:00100000:2.0:1784938064.443128:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065488640:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938064.443179:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938064.443264:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065488640:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 137us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938064.443272:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 20 00000100:00080000:2.0:1784938064.443298:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938064.443410:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822e300 x1871643065488640/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938080 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938064.443437:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065488640:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:00100000:1.0:1784938064.557958:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:1.0:1784938064.557973:0:6628:0:(genops.c:906:class_export_put()) final put ffffa05ae1726000/8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:0.0:1784938064.558056:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1726000/8bbc0047-63c1-4cac-b5e6-ede401808e2e for lustre-OST0000 00000020:00000080:0.0:1784938064.558120:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ae1721800 for lustre-OST0000 00010000:00010000:3.0:1784938064.757881:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938065.785852:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938066.483641:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065488768:0@lo:400:kworker.0 00000100:00100000:1.0:1784938066.483727:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938066.483776:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065489280:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.483847:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938066.483854:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065489152:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.483914:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065488896:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.483941:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065489408:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.483967:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938066.483973:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065489024:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.484015:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488768 00000100:00100000:1.0:1784938066.484022:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488768 00000100:00100000:1.0:1784938066.484067:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784938066.484077:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065488768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938066.484159:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065488768:12345-0@lo:400:kworker.0 Request processed in 83us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938066.484167:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1784938066.484414:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938066.484472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938066.484497:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938066.484518:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938066.484541:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938066.484568:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489152 00000100:00100000:1.0:1784938066.484574:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489152 00000100:00100000:1.0:1784938066.484610:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489408 00000100:00100000:1.0:1784938066.484613:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489408 00000100:00100000:1.0:1784938066.484635:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:1.0:1784938066.484643:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065489152:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.484681:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065489152:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 37us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938066.484688:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:1.0:1784938066.484709:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 23 00000100:00100000:1.0:1784938066.484728:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065489408:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.484749:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065489408:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938066.484755:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 23 00000100:00100000:1.0:1784938066.484774:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489280 00000100:00100000:1.0:1784938066.484778:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489280 00000100:00100000:1.0:1784938066.484804:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065488896 00000100:00100000:1.0:1784938066.484806:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065488896 00000100:00100000:1.0:1784938066.484816:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489024 00000100:00100000:1.0:1784938066.484819:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489024 00000100:00100000:1.0:1784938066.484834:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:1.0:1784938066.484841:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065489280:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.484865:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065489280:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938066.484871:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:1.0:1784938066.484883:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 41 00000100:00100000:1.0:1784938066.484889:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065488896:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.484908:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065488896:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 20us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938066.484914:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 41 00000100:00100000:1.0:1784938066.484925:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 42 00000100:00100000:1.0:1784938066.484930:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065489024:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.484947:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065489024:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 17us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938066.484961:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 42 00000100:00080000:1.0:1784938066.484984:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938066.484989:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938066.484991:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938066.485030:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065488768:0@lo:400:kworker.0 00000100:00100000:1.0:1784938066.485194:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065489024:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.485205:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065488896:192.168.201.158@tcp:400:kworker.0 00010000:00080000:1.0:1784938066.485241:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822c380 x1871643065489408/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938066.485253:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065489408:192.168.201.158@tcp:400:kworker.0 00010000:00080000:1.0:1784938066.485280:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822e300 x1871643065489152/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938066.485290:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065489152:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938066.485301:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065489280:192.168.201.158@tcp:400:kworker.0 00010000:00010000:0.0:1784938066.806288:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938066.893460:0:8916:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing yml_node 00000100:00100000:3.0:1784938066.995484:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938066.995522:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065489536:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938066.995891:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938066.995926:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489536 00000100:00100000:3.0:1784938066.995935:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489536 00000100:00100000:3.0:1784938066.995993:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00100000:3.0:1784938066.996022:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065489536:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938066.996072:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938066.996125:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065489536:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 104us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938066.996132:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 21 00010000:00080000:3.0:1784938066.996316:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbdf80 x1871643065489536/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938082 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938066.996337:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065489536:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:00100000:2.0:1784938067.602844:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:2.0:1784938067.602859:0:7507:0:(genops.c:906:class_export_put()) final put ffffa059c34f7800/8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:3.0:1784938067.605658:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa059c34f7800/8bbc0047-63c1-4cac-b5e6-ede401808e2e for lustre-OST0001 00000020:00000080:3.0:1784938067.605757:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ae1723800 for lustre-OST0001 00010000:00010000:2.0:1784938067.828900:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938068.414490:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938068.414546:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938068.414674:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681344 00000100:00100000:2.0:1784938068.414700:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681344 00000100:00100000:2.0:1784938068.414809:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784938068.414824:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048681344:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938068.414931:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048681344:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 110us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938068.414951:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00080000:1.0:1784938068.415380:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938068.415547:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681216 00000100:00100000:3.0:1784938068.415554:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681216 00000100:00100000:3.0:1784938068.415608:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:3.0:1784938068.415618:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048681216:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938068.415661:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048681216:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 45us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938068.415667:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 197 00010000:00010000:0.0:1784938068.849721:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938069.564602:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065489664:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938069.565033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938069.565066:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489664 00000100:00100000:2.0:1784938069.565075:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489664 00000100:00100000:2.0:1784938069.565144:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:2.0:1784938069.565156:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065489664:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938069.565204:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938069.565303:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065489664:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 149us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938069.565312:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00080000:2.0:1784938069.565336:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938069.565580:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824380 x1871643065489664/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938069.565604:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065489664:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938069.880359:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938070.899691:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938071.602785:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065489920:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.602927:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065490432:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.602982:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938071.602989:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065490048:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.603286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938071.603554:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065490176:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938071.603597:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784938071.603605:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065489792:0@lo:400:kworker.0 00000100:00100000:0.0:1784938071.603654:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938071.603686:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065490304:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938071.603742:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489792 00000100:00100000:0.0:1784938071.603752:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489792 00000100:00100000:0.0:1784938071.603812:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784938071.603822:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065489792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938071.603888:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065489792:12345-0@lo:400:kworker.0 Request processed in 65us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938071.603896:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1784938071.603959:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065489792:0@lo:400:kworker.0 00000100:00100000:0.0:1784938071.604071:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938071.604113:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938071.604168:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065489920 00000100:00100000:0.0:1784938071.604172:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065489920 00000100:00100000:0.0:1784938071.604201:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490048 00000100:00100000:0.0:1784938071.604204:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490048 00000100:00100000:0.0:1784938071.604262:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 44 00000100:00100000:0.0:1784938071.604270:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065489920:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938071.604438:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065489920:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 168us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938071.604618:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 44 00000100:00100000:0.0:1784938071.604643:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 45 00000100:00100000:0.0:1784938071.604650:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065490048:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938071.604674:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065490048:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 26us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938071.604680:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 45 00000100:00080000:0.0:1784938071.604868:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938071.605110:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938071.605134:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938071.605154:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490304 00000100:00100000:2.0:1784938071.605159:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490304 00000100:00100000:2.0:1784938071.605206:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 46 00000100:00100000:2.0:1784938071.605230:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065490304:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.605268:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065490304:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 56us (133us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938071.605275:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 46 00000100:00100000:3.0:1784938071.605424:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065490048:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938071.605439:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065489920:192.168.201.158@tcp:400:kworker.0 00000100:00080000:3.0:1784938071.605646:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938071.606440:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490432 00000100:00100000:0.0:1784938071.606606:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490432 00000100:00100000:0.0:1784938071.606680:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490176 00000100:00100000:0.0:1784938071.606684:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490176 00000100:00100000:2.0:1784938071.606817:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00100000:2.0:1784938071.606831:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065490432:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.606904:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065490432:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 78us (3618us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938071.606911:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00100000:2.0:1784938071.606931:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 25 00000100:00100000:2.0:1784938071.606938:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065490176:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.606962:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065490176:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 26us (1855us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938071.606969:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 25 00000100:00100000:2.0:1784938071.607263:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065490304:192.168.201.158@tcp:400:kworker.0 00010000:00080000:2.0:1784938071.607283:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52ba300 x1871643065490176/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938071.607421:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938071.607439:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1784938071.607490:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52b8e00 x1871643065490432/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938087 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938071.607502:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065490432:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938071.608605:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065490176:192.168.201.158@tcp:400:kworker.0 00010000:00010000:0.0:1784938071.928577:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938072.115135:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065490560:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938072.115595:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938072.115643:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490560 00000100:00100000:2.0:1784938072.115652:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490560 00000100:00100000:2.0:1784938072.115878:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 23 00000100:00100000:2.0:1784938072.115891:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065490560:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938072.115950:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938072.116495:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065490560:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 115us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938072.116509:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 23 00010000:00080000:2.0:1784938072.116866:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbdf80 x1871643065490560/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938072.116892:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065490560:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:02000400:2.0:1784938072.623986:0:9110:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.203 00010000:00010000:3.0:1784938072.948480:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938073.525856:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938073.526003:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681472 00000100:00100000:1.0:1784938073.526014:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681472 00000100:00100000:1.0:1784938073.526089:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:1.0:1784938073.526100:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2356:x1871643048681472:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938073.526197:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2356:x1871643048681472:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 99us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938073.526240:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:0.0:1784938073.532011:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938073.532137:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681600 00000100:00100000:2.0:1784938073.532148:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681600 00000100:00100000:2.0:1784938073.532264:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1784938073.532275:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048681600:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938073.532366:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048681600:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 92us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938073.532375:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00080000:0.0:1784938073.532692:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938073.971706:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938074.675107:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065490688:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938074.676811:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938074.677558:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490688 00000100:00100000:1.0:1784938074.677580:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490688 00000100:00100000:1.0:1784938074.677858:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00100000:1.0:1784938074.677869:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065490688:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938074.677914:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938074.677986:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065490688:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 120us (1188us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938074.677991:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00080000:0.0:1784938074.679260:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938074.679777:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2825c00 x1871643065490688/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938074.679811:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065490688:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938074.994312:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938075.909435:0:9207:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.203 00010000:00010000:0.0:1784938076.017806:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938076.723871:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065490944:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.724049:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065490816:0@lo:400:kworker.0 00000100:00100000:0.0:1784938076.724170:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065491456:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.728249:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938076.728321:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065491328:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.728423:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938076.728431:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065491200:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.728483:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490816 00000100:00100000:1.0:1784938076.728492:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490816 00000100:00100000:1.0:1784938076.728564:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1784938076.728574:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065490816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938076.728638:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065490816:12345-0@lo:400:kworker.0 Request processed in 65us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938076.728656:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1784938076.728801:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938076.728830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938076.728855:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491328 00000100:00100000:1.0:1784938076.728858:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491328 00000100:00100000:1.0:1784938076.728902:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 48 00000100:00100000:1.0:1784938076.728909:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065491328:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.728940:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065491328:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 31us (139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938076.728959:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 48 00000100:00100000:1.0:1784938076.728981:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491200 00000100:00100000:1.0:1784938076.728985:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491200 00000100:00100000:1.0:1784938076.729016:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00100000:1.0:1784938076.729022:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065491200:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.729050:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065491200:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938076.729056:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00080000:1.0:1784938076.729071:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938076.729076:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784938076.729169:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5378000 x1871643065491200/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938076.729188:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065491200:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.729201:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2827b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065490816:0@lo:400:kworker.0 00000100:00100000:0.0:1784938076.730521:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938076.730561:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065491072:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938076.730845:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938076.730917:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491456 00000100:00100000:0.0:1784938076.730925:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491456 00000100:00100000:0.0:1784938076.730999:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 27 00000100:00100000:0.0:1784938076.731009:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065491456:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938076.731063:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065491456:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 55us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938076.731078:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 27 00010000:00080000:0.0:1784938076.731201:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5379880 x1871643065491456/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938076.731251:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065491456:192.168.201.158@tcp:400:kworker.0 00000100:00080000:1.0:1784938076.731405:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938076.732191:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938076.736512:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938076.737068:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5379500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065491328:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938076.743771:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065490944 00000100:00100000:2.0:1784938076.743792:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065490944 00000100:00100000:2.0:1784938076.743869:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491072 00000100:00100000:2.0:1784938076.743872:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491072 00000100:00100000:2.0:1784938076.743925:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 49 00000100:00100000:2.0:1784938076.743937:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065490944:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938076.744075:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065490944:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 138us (11885us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938076.744091:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 49 00000100:00100000:2.0:1784938076.744116:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 50 00000100:00100000:2.0:1784938076.744123:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065491072:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938076.744149:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065491072:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (7656us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938076.744156:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 50 00000100:00100000:0.0:1784938076.744706:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065491072:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938076.744722:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065490944:192.168.201.158@tcp:400:kworker.0 00000100:00080000:1.0:1784938076.744819:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938077.042958:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938077.233828:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065491584:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938077.234274:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938077.235711:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491584 00000100:00100000:1.0:1784938077.235727:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491584 00000100:00100000:1.0:1784938077.235814:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 25 00000100:00100000:1.0:1784938077.235826:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065491584:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938077.235883:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938077.235988:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065491584:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 164us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938077.235997:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 25 00010000:00080000:2.0:1784938077.243036:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbe680 x1871643065491584/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938077.243077:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065491584:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:0.0:1784938078.076243:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938078.645349:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938078.645411:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938078.645449:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681728 00000100:00100000:3.0:1784938078.645458:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681728 00000100:00100000:3.0:1784938078.645517:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:3.0:1784938078.645527:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048681728:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938078.645611:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048681728:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 85us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938078.645619:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:1.0:1784938078.646118:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681856 00000100:00100000:1.0:1784938078.646123:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681856 00000100:00100000:1.0:1784938078.646175:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:1.0:1784938078.646182:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048681856:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938078.646249:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048681856:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 68us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938078.646257:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00080000:3.0:1784938078.646735:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1784938078.739739:0:9306:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.203 00010000:00010000:2.0:1784938079.095946:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938079.793974:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065491712:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938079.794441:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938079.794758:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491712 00000100:00100000:1.0:1784938079.794770:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491712 00000100:00100000:1.0:1784938079.794862:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00100000:1.0:1784938079.794874:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065491712:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938079.794923:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938079.795001:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065491712:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 129us (561us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938079.795009:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00080000:2.0:1784938079.795071:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938079.795325:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5379880 x1871643065491712/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938079.795417:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5379880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065491712:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:3.0:1784938080.116569:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938080.479843:0:9354:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jul 24 20:07:59 EDT 2026 00010000:00010000:2.0:1784938081.140513:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938081.841654:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065492096:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938081.841812:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784938081.841821:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065491968:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938081.841857:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065492480:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938081.842145:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938081.842200:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938081.842365:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065491840:0@lo:400:kworker.0 00000100:00100000:1.0:1784938081.842411:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938081.842439:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065492352:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938081.842482:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938081.842489:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065492224:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938081.842530:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491840 00000100:00100000:1.0:1784938081.842539:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491840 00000100:00100000:1.0:1784938081.842595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784938081.842605:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065491840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938081.842669:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065491840:12345-0@lo:400:kworker.0 Request processed in 65us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938081.842678:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1784938081.842740:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065491840:0@lo:400:kworker.0 00000100:00100000:2.0:1784938081.843716:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938081.843843:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938081.843864:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938081.844841:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065491968 00000100:00100000:0.0:1784938081.844855:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065491968 00000100:00100000:0.0:1784938081.845111:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492096 00000100:00100000:0.0:1784938081.845116:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492096 00000100:00100000:0.0:1784938081.845151:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492352 00000100:00100000:0.0:1784938081.845154:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492352 00000100:00100000:0.0:1784938081.845177:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 52 00000100:00100000:0.0:1784938081.845186:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065491968:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938081.845412:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff837480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065491968:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 225us (3266us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938081.845420:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 52 00000100:00100000:0.0:1784938081.845439:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:0.0:1784938081.845446:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065492096:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938081.845481:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff834700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065492096:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 36us (3281us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938081.845488:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:0.0:1784938081.845522:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 54 00000100:00100000:0.0:1784938081.845528:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065492352:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938081.845554:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff834000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065492352:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 26us (1711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938081.845560:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 54 00000100:00100000:2.0:1784938081.845839:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492480 00000100:00100000:2.0:1784938081.845844:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492480 00000100:00100000:2.0:1784938081.845875:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492224 00000100:00100000:2.0:1784938081.845878:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492224 00000100:00100000:2.0:1784938081.846142:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00100000:2.0:1784938081.846151:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065492480:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938081.846185:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff837800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065492480:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 36us (2472us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938081.846191:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00100000:2.0:1784938081.846238:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 29 00000100:00100000:2.0:1784938081.846245:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065492224:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938081.846284:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065492224:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 40us (2419us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938081.846291:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 29 00010000:00080000:3.0:1784938081.860038:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aff834e00 x1871643065492224/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938081.860064:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff834e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065492224:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938081.860079:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065492352:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938081.860152:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065491968:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938081.860165:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aff836a00 x1871643065492480/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938081.860176:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff836a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065492480:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938081.860200:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065492096:192.168.201.158@tcp:400:kworker.0 00000100:00080000:0.0:1784938081.860934:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938081.860944:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938081.860948:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938082.171374:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938082.355523:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065492608:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938082.355918:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938082.355957:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492608 00000100:00100000:3.0:1784938082.355967:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492608 00000100:00100000:3.0:1784938082.356024:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 27 00000100:00100000:3.0:1784938082.356118:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065492608:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938082.356168:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938082.356245:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065492608:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 211us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938082.356254:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 27 00010000:00080000:3.0:1784938082.356491:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbe680 x1871643065492608/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938082.356514:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065492608:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938083.185477:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938083.764166:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938083.764341:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048681984 00000100:00100000:3.0:1784938083.764354:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048681984 00000100:00100000:3.0:1784938083.764441:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:3.0:1784938083.764452:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2356:x1871643048681984:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938083.764717:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2356:x1871643048681984:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 266us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938083.764726:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:1.0:1784938083.764985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938083.765041:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682112 00000100:00100000:0.0:1784938083.765047:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682112 00000100:00100000:0.0:1784938083.765116:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:0.0:1784938083.765124:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048682112:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938083.765164:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048682112:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 42us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938083.765171:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00080000:1.0:1784938083.765394:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784938084.218646:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938084.914617:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938084.914656:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065492736:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938084.915010:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938084.915046:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492736 00000100:00100000:3.0:1784938084.915055:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492736 00000100:00100000:3.0:1784938084.915126:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00100000:3.0:1784938084.915138:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065492736:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938084.915186:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938084.915548:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065492736:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 410us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938084.915558:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00080000:3.0:1784938084.915585:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938084.917535:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbe680 x1871643065492736/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938100 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938084.917582:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065492736:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938085.233689:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938086.260413:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938086.961605:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065492864:0@lo:400:kworker.0 00000100:00100000:2.0:1784938086.961728:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938086.961801:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065493376:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.961883:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938086.961891:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065493248:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.962120:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938086.962247:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938086.962283:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493376 00000100:00100000:2.0:1784938086.962292:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493376 00000100:00100000:2.0:1784938086.962358:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 56 00000100:00100000:2.0:1784938086.962381:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065493376:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.962438:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065493376:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 59us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938086.962447:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 56 00000100:00100000:2.0:1784938086.962474:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493248 00000100:00100000:2.0:1784938086.962478:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493248 00000100:00100000:2.0:1784938086.962511:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 30 00000100:00100000:2.0:1784938086.962518:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065493248:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.962548:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff834a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065493248:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938086.962555:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 30 00000100:00080000:2.0:1784938086.962572:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938086.962577:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784938086.962726:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52b8e00 x1871643065493248/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938086.962744:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065493248:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.962771:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065493376:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938086.962939:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492864 00000100:00100000:1.0:1784938086.962945:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492864 00000100:00100000:1.0:1784938086.962989:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1784938086.962996:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065492864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938086.963050:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065492864:12345-0@lo:400:kworker.0 Request processed in 54us (1322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938086.963064:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1784938086.963183:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065492864:0@lo:400:kworker.0 00000100:00100000:3.0:1784938086.963489:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065492992:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938086.963554:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065493504:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938086.963585:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938086.963593:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065493120:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.963870:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938086.963901:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938086.963927:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938086.963995:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065492992 00000100:00100000:1.0:1784938086.964002:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065492992 00000100:00100000:1.0:1784938086.964046:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493120 00000100:00100000:1.0:1784938086.964050:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493120 00000100:00100000:1.0:1784938086.964084:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 57 00000100:00100000:1.0:1784938086.964093:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065492992:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938086.978242:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff834380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065492992:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 14114us (14338us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938086.978261:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 57 00000100:00100000:1.0:1784938086.978923:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 58 00000100:00100000:1.0:1784938086.978939:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065493120:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938086.986637:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065492992:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.988718:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493504 00000100:00100000:2.0:1784938086.988739:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493504 00000100:00100000:2.0:1784938086.988890:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 31 00000100:00100000:2.0:1784938086.988905:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065493504:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938086.989015:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065493504:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 114us (25112us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938086.989025:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 31 00000100:00100000:1.0:1784938086.990047:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff837b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065493120:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 11096us (26102us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938086.990061:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 58 00000100:00100000:3.0:1784938086.991589:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065493120:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938086.991615:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824380 x1871643065493504/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938086.991656:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065493504:192.168.201.158@tcp:400:kworker.0 00000100:00080000:2.0:1784938086.998389:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938086.998404:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938087.281385:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938087.473945:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938087.478986:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065493632:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938087.479626:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938087.479785:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493632 00000100:00100000:1.0:1784938087.479799:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493632 00000100:00100000:1.0:1784938087.479873:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 29 00000100:00100000:1.0:1784938087.479885:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065493632:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938087.479942:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938087.479998:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065493632:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 114us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938087.480007:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 29 00010000:00080000:1.0:1784938087.480646:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbf100 x1871643065493632/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938087.480673:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065493632:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938088.307049:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938088.894756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938088.894794:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938088.894847:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682368 00000100:00100000:3.0:1784938088.894858:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682368 00000100:00100000:1.0:1784938088.895491:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682240 00000100:00100000:1.0:1784938088.895497:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682240 00000100:00100000:3.0:1784938088.895509:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:3.0:1784938088.895521:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048682368:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938088.895527:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:1.0:1784938088.895533:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048682240:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938088.895623:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048682240:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 90us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938088.895632:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:3.0:1784938088.895661:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048682368:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 143us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938088.895668:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00080000:3.0:1784938088.895693:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938089.334148:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938090.037417:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938090.037452:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065493760:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938090.037981:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938090.038061:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493760 00000100:00100000:2.0:1784938090.038072:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493760 00000100:00100000:2.0:1784938090.038156:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 30 00000100:00100000:2.0:1784938090.038168:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065493760:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938090.038234:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938090.038290:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065493760:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938090.038298:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 30 00000100:00080000:0.0:1784938090.038678:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1784938090.038961:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5378380 x1871643065493760/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938090.038990:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065493760:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938090.353830:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938091.377361:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938092.081502:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065494272:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.081666:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784938092.081676:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065493888:0@lo:400:kworker.0 00000100:00100000:0.0:1784938092.081730:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938092.081769:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065494400:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.081830:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065494144:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.081857:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1784938092.081863:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065494016:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.082089:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af537a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065494528:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.082517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938092.082779:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938092.082807:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938092.082830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938092.082849:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938092.082883:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065493888 00000100:00100000:0.0:1784938092.082948:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065493888 00000100:00100000:0.0:1784938092.083010:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784938092.083020:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065493888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938092.083084:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065493888:12345-0@lo:400:kworker.0 Request processed in 65us (1353us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938092.083094:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1784938092.083138:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494400 00000100:00100000:0.0:1784938092.083141:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494400 00000100:00100000:0.0:1784938092.083180:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494016 00000100:00100000:0.0:1784938092.083183:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494016 00000100:00100000:0.0:1784938092.083196:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494144 00000100:00100000:0.0:1784938092.083198:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494144 00000100:00100000:0.0:1784938092.083238:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 60 00000100:00100000:0.0:1784938092.083246:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065494400:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.083371:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065494400:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 125us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938092.083389:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 60 00000100:00100000:0.0:1784938092.083404:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 61 00000100:00100000:0.0:1784938092.083411:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065494016:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.083437:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065494016:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938092.083444:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 61 00000100:00100000:0.0:1784938092.083456:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 62 00000100:00100000:0.0:1784938092.083462:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065494144:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.083484:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065494144:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938092.083491:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 62 00000100:00100000:0.0:1784938092.083514:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494272 00000100:00100000:0.0:1784938092.083518:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494272 00000100:00100000:0.0:1784938092.083544:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494528 00000100:00100000:0.0:1784938092.083547:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494528 00000100:00100000:0.0:1784938092.085082:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 32 00000100:00100000:3.0:1784938092.085093:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 33 00000100:00100000:3.0:1784938092.085106:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065494528:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.085106:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065494272:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.085174:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065494272:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 79us (2365us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938092.085182:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 32 00000100:00080000:0.0:1784938092.085227:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938092.085232:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938092.085235:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938092.085310:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af537bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065493888:0@lo:400:kworker.0 00000100:00100000:3.0:1784938092.088557:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065494528:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 3436us (5687us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938092.088581:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 33 00010000:00080000:3.0:1784938092.088938:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af537a300 x1871643065494528/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938092.088956:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af537a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065494528:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938092.089376:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af537a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065494400:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938092.089414:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af537ad80 x1871643065494272/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938108 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938092.089425:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af537ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065494272:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938092.092893:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af537b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065494016:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938092.092923:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5379f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065494144:192.168.201.158@tcp:400:kworker.0 00010000:00010000:1.0:1784938092.403764:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938092.593925:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065494656:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938092.598656:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938092.598710:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494656 00000100:00100000:0.0:1784938092.598720:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494656 00000100:00100000:0.0:1784938092.598773:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 31 00000100:00100000:0.0:1784938092.598783:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065494656:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938092.598835:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938092.598900:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065494656:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 119us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938092.598908:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 31 00010000:00080000:1.0:1784938092.599193:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbf480 x1871643065494656/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938108 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938092.599240:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065494656:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938093.425410:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938094.002780:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938094.002831:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938094.002915:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682496 00000100:00100000:2.0:1784938094.002926:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682496 00000100:00100000:0.0:1784938094.002934:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682624 00000100:00100000:0.0:1784938094.002941:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682624 00000100:00100000:0.0:1784938094.002995:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:0.0:1784938094.003003:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048682624:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938094.003012:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:2.0:1784938094.003022:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048682496:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:1.0:1784938094.003077:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938094.003078:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048682624:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 75us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938094.003089:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1784938094.003145:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2358:x1871643048682496:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 124us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938094.003152:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 207 00010000:00010000:3.0:1784938094.458083:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938095.155682:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065494784:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938095.156028:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938095.156532:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494784 00000100:00100000:0.0:1784938095.156541:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494784 00000100:00100000:0.0:1784938095.156644:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 32 00000100:00100000:0.0:1784938095.156655:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065494784:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938095.156701:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938095.156751:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065494784:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 98us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938095.156759:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 32 00010000:00080000:0.0:1784938095.156935:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824380 x1871643065494784/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938095.156957:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065494784:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:1.0:1784938095.157118:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938095.476028:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938096.500578:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938097.207066:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938097.207323:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065495040:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.207442:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938097.207450:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065495168:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.207644:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938097.207731:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938097.207763:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495040 00000100:00100000:0.0:1784938097.207770:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495040 00000100:00100000:0.0:1784938097.207815:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495168 00000100:00100000:0.0:1784938097.207818:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495168 00000100:00100000:0.0:1784938097.207848:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 64 00000100:00100000:0.0:1784938097.207869:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065495040:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.207921:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065495040:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 64us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938097.207929:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 64 00000100:00100000:0.0:1784938097.207950:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00100000:0.0:1784938097.207957:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065495168:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.208002:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065495168:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 45us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938097.208009:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00100000:0.0:1784938097.208169:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff836d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065495168:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.208180:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065495040:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938097.210068:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065495296:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938097.210171:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065494912:0@lo:400:kworker.0 00000100:00100000:1.0:1784938097.210248:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1784938097.210320:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938097.210339:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065494912 00000100:00100000:1.0:1784938097.210354:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065494912 00000100:00100000:1.0:1784938097.210404:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784938097.210413:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065494912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938097.210466:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065494912:12345-0@lo:400:kworker.0 Request processed in 53us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.210473:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1784938097.210518:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff837100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065494912:0@lo:400:kworker.0 00000100:00100000:0.0:1784938097.210835:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938097.210869:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495296 00000100:00100000:0.0:1784938097.210873:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495296 00000100:00100000:0.0:1784938097.210908:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 34 00000100:00100000:0.0:1784938097.210915:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065495296:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.210957:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065495296:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 42us (123us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938097.210962:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 34 00000100:00080000:1.0:1784938097.211262:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938097.211301:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aff836680 x1871643065495296/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938097.211314:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff836680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065495296:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938097.213516:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938097.213539:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065495552:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938097.213647:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938097.213659:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065495424:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.213917:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938097.213950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938097.214237:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495552 00000100:00100000:3.0:1784938097.214245:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495552 00000100:00100000:3.0:1784938097.214312:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 35 00000100:00100000:3.0:1784938097.214322:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065495552:12345-192.168.201.158@tcp:400:kworker.0 00000100:00080000:1.0:1784938097.214928:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938097.217495:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065495552:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 3159us (3564us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938097.217512:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 35 00000100:00100000:0.0:1784938097.219767:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495424 00000100:00100000:0.0:1784938097.219782:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495424 00000100:00100000:0.0:1784938097.219874:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 66 00000100:00100000:0.0:1784938097.219885:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065495424:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938097.219972:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065495424:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 89us (6020us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938097.219980:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 66 00000100:00100000:0.0:1784938097.220381:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065495424:192.168.201.158@tcp:400:kworker.0 00000100:00080000:3.0:1784938097.220463:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784938097.220616:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbf480 x1871643065495552/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938113 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938097.220631:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065495552:192.168.201.158@tcp:400:kworker.0 00000001:02000400:0.0:1784938097.243818:0:9983:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 20:08:16 (1784938096) === 00010000:00010000:2.0:1784938097.521819:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938097.603698:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938097.603789:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682752 00000100:00100000:2.0:1784938097.603800:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682752 00000100:00100000:2.0:1784938097.603863:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:2.0:1784938097.603873:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+10:8100:x1871643048682752:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938097.603905:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938097.603924:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892c00/0xea86628a8aec378c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8977d0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938097.603983:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892c00/0xea86628a8aec378c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977d0 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938097.603995:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892c00/0xea86628a8aec378c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977d0 expref: 11 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938097.604005:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892c00, rc 0) 00000100:00100000:2.0:1784938097.604074:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8100:x1871643048682752:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 202us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938097.604082:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:3.0:1784938097.611701:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.615849:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048682880 00000100:00100000:1.0:1784938097.615863:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048682880 00000100:00100000:1.0:1784938097.616112:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:1.0:1784938097.616123:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8100:x1871643048682880:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784938097.617428:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8100:x1871643048682880:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 1300us (5729us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.617440:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:3.0:1784938097.619668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.619754:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683008 00000100:00100000:1.0:1784938097.619765:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683008 00000100:00100000:1.0:1784938097.619817:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:1.0:1784938097.619826:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8100:x1871643048683008:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784938097.620199:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8100:x1871643048683008:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 372us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.620250:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:0.0:1784938097.625645:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.626281:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683136 00000100:00100000:1.0:1784938097.626297:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683136 00000100:00100000:1.0:1784938097.626445:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:1.0:1784938097.626459:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8104:x1871643048683136:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938097.627041:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8104:x1871643048683136:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 582us (1410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.627051:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:3.0:1784938097.638457:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.638646:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683264 00000100:00100000:1.0:1784938097.638661:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683264 00000100:00100000:1.0:1784938097.638742:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:1.0:1784938097.638764:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8104:x1871643048683264:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938097.639196:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8104:x1871643048683264:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 443us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.639206:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:3.0:1784938097.643094:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.643363:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683392 00000100:00100000:1.0:1784938097.643376:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683392 00000100:00100000:1.0:1784938097.643450:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:1.0:1784938097.643462:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:8100:x1871643048683392:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938097.643485:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938097.643510:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec3793 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8977fa expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938097.643547:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec3793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977fa expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938097.643586:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec3793 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977fa expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938097.643597:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990c00, rc 0) 00000100:00100000:1.0:1784938097.643673:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:8100:x1871643048683392:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 213us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.643680:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:0.0:1784938097.648707:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.649044:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683520 00000100:00100000:1.0:1784938097.649058:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683520 00000100:00100000:1.0:1784938097.649134:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:1.0:1784938097.649144:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:8100:x1871643048683520:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:1.0:1784938097.649176:0:5798:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1784938097.649251:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1784938097.649255:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1784938097.649304:0:5798:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1784938097.649306:0:5798:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1784938097.651053:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:8100:x1871643048683520:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 1896us (2348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.651066:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:0.0:1784938097.653827:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938097.654001:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683648 00000100:00100000:2.0:1784938097.654014:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683648 00000100:00100000:2.0:1784938097.654126:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:2.0:1784938097.654137:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:8100:x1871643048683648:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938097.654163:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938097.654202:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897801 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938097.654291:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938097.654306:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938097.654340:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892600, rc 0) 00000100:00100000:2.0:1784938097.654412:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8100:x1871643048683648:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 276us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938097.654419:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:0.0:1784938097.658300:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.658390:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683776 00000100:00100000:1.0:1784938097.658404:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683776 00000100:00100000:1.0:1784938097.658515:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:1.0:1784938097.658526:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8100:x1871643048683776:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:1.0:1784938097.658934:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8100:x1871643048683776:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 409us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.658952:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:0.0:1784938097.661194:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938097.661316:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048683904 00000100:00100000:2.0:1784938097.661328:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048683904 00000100:00100000:2.0:1784938097.661433:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:2.0:1784938097.661445:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8100:x1871643048683904:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784938097.661886:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8100:x1871643048683904:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 442us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938097.661896:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:0.0:1784938097.670513:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938097.670650:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684032 00000100:00100000:1.0:1784938097.670663:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684032 00000100:00100000:1.0:1784938097.670908:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:1.0:1784938097.670921:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8106:x1871643048684032:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938097.671272:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8106:x1871643048684032:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 354us (773us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.671282:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:0.0:1784938097.673888:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938097.674022:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684160 00000100:00100000:2.0:1784938097.674036:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684160 00000100:00100000:2.0:1784938097.674120:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:2.0:1784938097.674129:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8106:x1871643048684160:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938097.674509:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:8106:x1871643048684160:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 381us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938097.674516:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:0.0:1784938097.682061:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938097.682119:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938097.683345:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684288 00000100:00100000:2.0:1784938097.683374:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684288 00000100:00100000:2.0:1784938097.683452:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684672 00000100:00100000:2.0:1784938097.683456:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684672 00000100:00100000:0.0:1784938097.683488:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784938097.683499:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2354:x1871643048684288:12345-192.168.201.58@tcp:38:mount.lustre.0 00000100:00100000:2.0:1784938097.683512:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:2.0:1784938097.683519:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048684672:12345-192.168.201.58@tcp:400:kworker.0 00010000:00080000:0.0:1784938097.683539:0:7211:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from c6a50b74-5d5a-412d-afac-0a1727d8185d@192.168.201.58@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:0.0:1784938097.683593:0:7211:0:(genops.c:1406:class_connect()) connect: client c6a50b74-5d5a-412d-afac-0a1727d8185d, cookie 0xea86628a8aec37a1 00000004:00100000:0.0:1784938097.683634:0:7211:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1784938097.683640:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048684672:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 121us (1520us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938097.683648:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00080000:3.0:1784938097.683885:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938097.683990:0:7211:0:(import.c:65:import_set_state_nolock()) ffffa05b01e02000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938097.684026:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2354:x1871643048684288:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 527us (1980us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938097.684034:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784938097.691052:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938097.691105:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938097.692062:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684544 00000100:00100000:3.0:1784938097.692078:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684544 00000100:00100000:3.0:1784938097.692171:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684416 00000100:00080000:1.0:1784938097.692171:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938097.692175:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684416 00000100:00100000:3.0:1784938097.692210:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784938097.692280:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784938097.692285:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+7:8100:x1871643048684544:12345-192.168.201.58@tcp:41:mount.lustre.0 00000100:00100000:1.0:1784938097.692290:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+7:0:x1871643048684416:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784938097.692354:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000004:00000024:3.0:1784938097.692393:0:5806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1784938097.692518:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+7:8100:x1871643048684544:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 235us (1480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.692518:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+7:0:x1871643048684416:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 229us (1411us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938097.692526:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784938097.692547:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784938097.697059:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938097.700001:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684800 00000100:00100000:2.0:1784938097.700024:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684800 00000100:00100000:2.0:1784938097.700234:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784938097.700249:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:8100:x1871643048684800:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:2.0:1784938097.700816:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:8100:x1871643048684800:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 567us (3770us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938097.700827:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1784938097.703832:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938097.703948:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938097.703988:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938097.704038:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685184 00000100:00100000:3.0:1784938097.704051:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685184 00000100:00100000:3.0:1784938097.704139:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:3.0:1784938097.704152:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:8100:x1871643048685184:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00200000:3.0:1784938097.704606:0:5807:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784938097.704779:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:8100:x1871643048685184:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 628us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938097.704788:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1784938097.705826:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048684928 00000100:00100000:2.0:1784938097.705839:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048684928 00000100:00100000:2.0:1784938097.705925:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685056 00000100:00100000:2.0:1784938097.705929:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685056 00000100:00100000:1.0:1784938097.705964:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1784938097.705973:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1871643048684928:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938097.706010:0:6605:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from c6a50b74-5d5a-412d-afac-0a1727d8185d@192.168.201.58@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1784938097.706056:0:6605:0:(genops.c:1406:class_connect()) connect: client c6a50b74-5d5a-412d-afac-0a1727d8185d, cookie 0xea86628a8aec37a8 00002000:00100000:1.0:1784938097.706071:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c6a50b74-5d5a-412d-afac-0a1727d8185d/ffffa05ae1723800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938097.706105:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938097.706413:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938097.706456:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ae1724000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938097.706560:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2354:x1871643048684928:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 585us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.706569:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1784938097.706590:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938097.706595:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1871643048685056:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938097.706619:0:6605:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from c6a50b74-5d5a-412d-afac-0a1727d8185d@192.168.201.58@tcp t0 exp 0000000000000000 cur 306 last 0 00000020:00000080:1.0:1784938097.706641:0:6605:0:(genops.c:1406:class_connect()) connect: client c6a50b74-5d5a-412d-afac-0a1727d8185d, cookie 0xea86628a8aec37af 00002000:00100000:1.0:1784938097.706647:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c6a50b74-5d5a-412d-afac-0a1727d8185d/ffffa05ae1727800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938097.706662:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938097.706800:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938097.706816:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ae1726000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938097.706842:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2354:x1871643048685056:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 246us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938097.706849:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784938097.713622:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065495680:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938097.714279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938097.714359:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495680 00000100:00100000:3.0:1784938097.714371:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495680 00000100:00100000:3.0:1784938097.714444:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 33 00000100:00100000:3.0:1784938097.714455:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065495680:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938097.714488:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938097.715775:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065495680:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 1308us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938097.715798:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 33 00010000:00080000:3.0:1784938097.716537:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fbf100 x1871643065495680/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938113 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938097.716567:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065495680:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:00100000:3.0:1784938098.280917:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6a50b74-5d5a-412d-afac-0a1727d8185d 00000001:00100000:1.0:1784938098.306680:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6a50b74-5d5a-412d-afac-0a1727d8185d 00010000:00010000:0.0:1784938098.547636:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938099.573622:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938100.276760:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065495808:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938100.280695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938100.281256:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495808 00000100:00100000:2.0:1784938100.281270:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495808 00000100:00100000:2.0:1784938100.281359:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 34 00000100:00100000:2.0:1784938100.281372:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065495808:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938100.281418:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938100.281498:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065495808:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 129us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938100.281507:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 34 00000100:00080000:1.0:1784938100.281681:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938100.282252:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5259c00 x1871643065495808/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938100.282280:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065495808:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:00100000:1.0:1784938100.346527:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6a50b74-5d5a-412d-afac-0a1727d8185d 00010000:00010000:2.0:1784938100.605457:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938101.618050:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938102.322116:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065495936:0@lo:400:kworker.0 00000100:00100000:2.0:1784938102.322275:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938102.322482:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065495936 00000100:00100000:3.0:1784938102.322492:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065495936 00000100:00100000:3.0:1784938102.322560:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784938102.322571:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065495936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938102.322653:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065495936:12345-0@lo:400:kworker.0 Request processed in 83us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.322669:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1784938102.322729:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065495936:0@lo:400:kworker.0 00000100:00100000:3.0:1784938102.323296:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065496192:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.323377:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1784938102.323384:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065496064:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.323420:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065496576:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.323675:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938102.323728:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938102.323755:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938102.323779:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496064 00000100:00100000:3.0:1784938102.323787:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496064 00000100:00100000:3.0:1784938102.323826:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496192 00000100:00100000:3.0:1784938102.323829:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496192 00000100:00100000:3.0:1784938102.323858:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 68 00000100:00100000:3.0:1784938102.323866:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065496064:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.323915:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065496064:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 49us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.323929:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 68 00000100:00100000:3.0:1784938102.323944:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 69 00000100:00100000:3.0:1784938102.323950:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065496192:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.323974:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065496192:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.323981:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 69 00000100:00100000:3.0:1784938102.324028:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496576 00000100:00100000:3.0:1784938102.324031:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496576 00000100:00100000:3.0:1784938102.324060:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 36 00000100:00100000:3.0:1784938102.324067:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065496576:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324096:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065496576:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 29us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.324112:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 36 00000100:00100000:3.0:1784938102.324303:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065496064:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938102.324319:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05b01fd0e00 x1871643065496576/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938102.324330:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065496576:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324340:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065496192:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324405:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065496448:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324447:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938102.324453:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065496320:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324539:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938102.324559:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938102.324577:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496320 00000100:00100000:3.0:1784938102.324580:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496320 00000100:00100000:3.0:1784938102.324608:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 37 00000100:00100000:3.0:1784938102.324615:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065496320:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324647:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065496320:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (87us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.324666:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 37 00000100:00100000:3.0:1784938102.324682:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496448 00000100:00100000:3.0:1784938102.324685:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496448 00000100:00100000:3.0:1784938102.324703:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 70 00000100:00100000:3.0:1784938102.324708:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065496448:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324732:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065496448:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.324739:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 70 00010000:00080000:3.0:1784938102.324837:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05b01fd2680 x1871643065496320/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938118 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938102.324848:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065496320:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.324858:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065496448:192.168.201.158@tcp:400:kworker.0 00000100:00080000:1.0:1784938102.328051:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938102.328069:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938102.328074:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938102.650204:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938102.710951:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938102.710999:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938102.711038:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938102.711062:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938102.711089:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938102.711130:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685568 00000100:00100000:3.0:1784938102.711141:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685568 00000100:00100000:3.0:1784938102.711211:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685440 00000100:00100000:3.0:1784938102.711249:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685440 00000100:00100000:3.0:1784938102.711276:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:3.0:1784938102.711288:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048685568:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938102.711393:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048685568:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 105us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.711534:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1784938102.711545:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048685440:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938102.711576:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048685440:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 35us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.711585:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00080000:1.0:1784938102.711615:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938102.711650:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685824 00000100:00100000:1.0:1784938102.711654:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685824 00000100:00100000:1.0:1784938102.711685:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685696 00000100:00100000:1.0:1784938102.711688:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685696 00000100:00100000:1.0:1784938102.711708:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:1.0:1784938102.711714:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048685824:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938102.711742:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048685824:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.711749:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:1.0:1784938102.711762:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1784938102.711768:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048685696:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938102.711791:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048685696:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (702us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938102.711797:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00080000:1.0:1784938102.711817:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938102.711820:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938102.711930:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:2.0:1784938102.713305:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685312 00000100:00100000:2.0:1784938102.713317:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685312 00000100:00100000:2.0:1784938102.713369:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:2.0:1784938102.713378:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048685312:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938102.713464:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048685312:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 86us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938102.713471:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:1.0:1784938102.833433:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938102.833459:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065496704:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938102.833768:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938102.833801:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496704 00000100:00100000:3.0:1784938102.833809:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496704 00000100:00100000:3.0:1784938102.833874:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 35 00000100:00100000:3.0:1784938102.833883:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065496704:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938102.833932:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938102.833971:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065496704:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 89us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938102.833979:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 35 00010000:00080000:1.0:1784938102.834359:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac8229500 x1871643065496704/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938118 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938102.834380:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065496704:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:02000400:1.0:1784938103.518537:0:10180:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1784938103.673311:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938104.689339:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938105.393389:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065496832:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938105.393734:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938105.393779:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496832 00000100:00100000:1.0:1784938105.393788:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496832 00000100:00100000:1.0:1784938105.393870:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 36 00000100:00100000:1.0:1784938105.393887:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065496832:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938105.393937:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938105.394017:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065496832:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 122us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938105.394026:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 36 00000100:00080000:1.0:1784938105.394066:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938105.395208:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5259c00 x1871643065496832/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938105.396708:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065496832:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938105.714462:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938106.741409:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938107.441549:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065497088:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.442164:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065497344:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.442289:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938107.442297:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065496960:0@lo:400:kworker.0 00000100:00100000:2.0:1784938107.442346:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938107.442380:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065497472:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.442549:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938107.442632:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938107.442659:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065496960 00000100:00100000:2.0:1784938107.442665:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065496960 00000100:00100000:2.0:1784938107.442712:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1784938107.442721:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065496960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938107.442785:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065496960:12345-0@lo:400:kworker.0 Request processed in 64us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.442792:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1784938107.442846:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497344 00000100:00100000:2.0:1784938107.442850:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497344 00000100:00100000:2.0:1784938107.442890:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:2.0:1784938107.442897:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065497344:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.442929:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065497344:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 33us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.442936:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:2.0:1784938107.442954:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497472 00000100:00100000:2.0:1784938107.442958:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497472 00000100:00100000:2.0:1784938107.442986:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 73 00000100:00100000:2.0:1784938107.442992:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065497472:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.443042:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065497472:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 41us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.443050:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 73 00000100:00080000:2.0:1784938107.443071:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938107.443076:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938107.443208:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065496960:0@lo:400:kworker.0 00000100:00100000:2.0:1784938107.443249:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065497472:192.168.201.158@tcp:400:kworker.0 00010000:00080000:2.0:1784938107.443263:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822bb80 x1871643065497344/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938107.443274:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065497344:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.443320:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065497216:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.443412:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938107.443432:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497216 00000100:00100000:2.0:1784938107.443444:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497216 00000100:00100000:2.0:1784938107.443477:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00100000:2.0:1784938107.443484:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065497216:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.443516:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff837100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065497216:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.443522:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00080000:2.0:1784938107.443594:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938107.443610:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065497216:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938107.450830:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065497600:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938107.461495:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938107.461530:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938107.461680:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497600 00000100:00100000:1.0:1784938107.461690:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497600 00000100:00100000:1.0:1784938107.461760:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 41 00000100:00100000:1.0:1784938107.461771:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065497600:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938107.461843:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065497600:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938107.461865:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 41 00000100:00100000:1.0:1784938107.461896:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497088 00000100:00100000:1.0:1784938107.461900:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497088 00000100:00100000:1.0:1784938107.461926:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 75 00000100:00100000:1.0:1784938107.461933:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065497088:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938107.461962:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065497088:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 29us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938107.461969:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 75 00000100:00100000:3.0:1784938107.462291:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065497088:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938107.462310:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac8229f80 x1871643065497600/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938123 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938107.462321:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065497600:192.168.201.158@tcp:400:kworker.0 00000100:00080000:0.0:1784938107.462413:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1784938107.768719:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938107.828751:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938107.828808:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938107.828866:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686208 00000100:00100000:2.0:1784938107.828884:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686208 00000100:00100000:2.0:1784938107.828992:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:2.0:1784938107.829017:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048686208:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.829308:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048686208:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 304us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.829317:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00080000:2.0:1784938107.829344:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938107.829413:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048685952 00000100:00100000:0.0:1784938107.829418:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048685952 00000100:00100000:0.0:1784938107.829499:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:0.0:1784938107.829506:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048685952:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938107.829549:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048685952:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 44us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938107.829555:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:3.0:1784938107.833773:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938107.837277:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686464 00000100:00100000:0.0:1784938107.837291:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686464 00000100:00100000:0.0:1784938107.837373:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784938107.837383:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afc8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048686464:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938107.837465:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afc8d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048686464:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 83us (3700us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938107.837474:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00080000:2.0:1784938107.839317:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938107.839488:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938107.839526:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686080 00000100:00100000:3.0:1784938107.839534:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686080 00000100:00100000:3.0:1784938107.839609:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1784938107.839619:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048686080:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938107.839773:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048686080:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 154us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938107.839781:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00080000:3.0:1784938107.839802:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938107.839841:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938107.842249:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686336 00000100:00100000:2.0:1784938107.842263:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686336 00000100:00080000:3.0:1784938107.842313:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938107.842342:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784938107.842352:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048686336:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938107.842435:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048686336:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 84us (2592us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.842443:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784938107.954137:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065497728:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938107.954513:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938107.954545:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497728 00000100:00100000:2.0:1784938107.954562:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497728 00000100:00100000:2.0:1784938107.954618:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 37 00000100:00100000:2.0:1784938107.954774:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065497728:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938107.954818:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938107.954860:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065497728:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 233us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938107.954868:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 37 00010000:00080000:1.0:1784938107.959458:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aff835f80 x1871643065497728/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938123 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938107.959488:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065497728:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938108.786340:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938109.810665:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938110.513485:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065497856:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938110.513830:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938110.513859:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497856 00000100:00100000:1.0:1784938110.513868:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497856 00000100:00100000:1.0:1784938110.513928:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 38 00000100:00100000:1.0:1784938110.513939:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065497856:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938110.513989:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938110.514038:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065497856:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 101us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938110.514046:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 38 00000100:00080000:1.0:1784938110.514067:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938110.516051:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5259c00 x1871643065497856/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938110.516083:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065497856:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938110.837251:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938111.857537:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938112.562047:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065498240:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938112.562177:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784938112.562185:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065498112:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938112.562260:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065498624:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938112.562455:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938112.562518:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938112.562539:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938112.562667:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065498368:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.562717:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784938112.562724:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065497984:0@lo:400:kworker.0 00000100:00100000:0.0:1784938112.562776:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938112.562798:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065498496:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.562897:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938112.562915:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938112.562963:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498112 00000100:00100000:0.0:1784938112.562972:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498112 00000100:00100000:0.0:1784938112.563022:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498240 00000100:00100000:0.0:1784938112.563024:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498240 00000100:00100000:0.0:1784938112.563049:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498496 00000100:00100000:0.0:1784938112.563052:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498496 00000100:00100000:0.0:1784938112.563070:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 78 00000100:00100000:0.0:1784938112.563079:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065498112:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.563135:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065498112:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 57us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938112.563142:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 78 00000100:00100000:0.0:1784938112.563161:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 79 00000100:00100000:0.0:1784938112.563167:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065498240:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.563193:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065498240:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938112.563199:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 79 00000100:00100000:0.0:1784938112.563211:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 80 00000100:00100000:0.0:1784938112.563245:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065498496:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.563270:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065498496:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938112.563277:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 80 00000100:00080000:0.0:1784938112.563302:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938112.563440:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065498496:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.563470:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065498112:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.563481:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065498240:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938112.564021:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498624 00000100:00100000:2.0:1784938112.564028:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498624 00000100:00100000:2.0:1784938112.564078:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498368 00000100:00100000:2.0:1784938112.564081:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498368 00000100:00100000:2.0:1784938112.564101:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 44 00000100:00100000:2.0:1784938112.564108:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065498624:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938112.564153:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065498624:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 46us (1612us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.564160:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 44 00000100:00100000:2.0:1784938112.564174:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 45 00000100:00100000:2.0:1784938112.564180:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065498368:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938112.564203:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065498368:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.564209:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 45 00000100:00100000:2.0:1784938112.564245:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065497984 00000100:00100000:2.0:1784938112.564249:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065497984 00000100:00100000:2.0:1784938112.564272:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1784938112.564278:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065497984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938112.564335:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065497984:12345-0@lo:400:kworker.0 Request processed in 56us (1558us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938112.564342:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1784938112.564948:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938112.564954:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1784938112.565077:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af525aa00 x1871643065498624/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938112.565092:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065498624:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938112.565134:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065497984:0@lo:400:kworker.0 00010000:00080000:2.0:1784938112.565146:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5258e00 x1871643065498368/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938128 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938112.565156:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065498368:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938112.882370:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938112.949574:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938112.949621:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938112.949655:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938112.949673:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938112.949696:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938112.949723:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686720 00000100:00100000:3.0:1784938112.949733:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686720 00000100:00100000:3.0:1784938112.949786:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686848 00000100:00100000:3.0:1784938112.949789:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686848 00000100:00100000:3.0:1784938112.949811:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784938112.949821:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048686720:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938112.949898:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048686720:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 78us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938112.949905:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784938112.949936:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1784938112.949944:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048686848:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938112.949967:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048686848:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938112.949985:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00080000:3.0:1784938112.950002:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938112.950140:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686592 00000100:00100000:1.0:1784938112.950145:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686592 00000100:00100000:1.0:1784938112.950180:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:1.0:1784938112.950187:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048686592:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938112.950242:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048686592:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 55us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938112.950250:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:0.0:1784938112.952296:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048686976 00000100:00100000:0.0:1784938112.952321:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048686976 00000100:00100000:0.0:1784938112.952391:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687104 00000100:00100000:0.0:1784938112.952395:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687104 00000100:00100000:0.0:1784938112.952424:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784938112.952434:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048686976:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.952505:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048686976:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 73us (2883us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938112.952513:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784938112.952529:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:0.0:1784938112.952547:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048687104:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938112.952574:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048687104:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938112.952581:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00080000:3.0:1784938112.953038:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938112.953043:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938113.073340:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065498752:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938113.073629:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938113.073678:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498752 00000100:00100000:1.0:1784938113.073686:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498752 00000100:00100000:1.0:1784938113.073732:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 39 00000100:00100000:1.0:1784938113.073741:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065498752:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938113.073779:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938113.073818:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065498752:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 77us (190us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938113.073843:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 39 00010000:00080000:1.0:1784938113.073997:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5258000 x1871643065498752/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938129 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938113.074018:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065498752:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938113.906273:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938114.929701:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938115.634710:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065498880:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938115.638111:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938115.641708:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065498880 00000100:00100000:0.0:1784938115.641725:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065498880 00000100:00100000:0.0:1784938115.642348:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:0.0:1784938115.642361:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065498880:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:3.0:1784938115.642501:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1784938115.642562:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938115.642646:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065498880:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 287us (4543us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938115.642655:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 40 00010000:00080000:3.0:1784938115.657891:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822aa00 x1871643065498880/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938115.657923:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065498880:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938115.953466:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938116.982330:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938117.682235:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065499264:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.682398:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065499392:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938117.682466:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065499136:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938117.682609:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065499008:0@lo:400:kworker.0 00000100:00100000:3.0:1784938117.682661:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938117.682692:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065499520:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.683994:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499008 00000100:00100000:2.0:1784938117.684007:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499008 00000100:00100000:2.0:1784938117.684072:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784938117.684081:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065499008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938117.684147:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065499008:12345-0@lo:400:kworker.0 Request processed in 67us (1485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.684153:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1784938117.684329:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938117.684402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938117.684426:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499264 00000100:00100000:2.0:1784938117.684429:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499264 00000100:00100000:2.0:1784938117.684472:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 83 00000100:00100000:2.0:1784938117.684478:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065499264:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.684920:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065499264:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 429us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.684929:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 83 00000100:00100000:2.0:1784938117.684954:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499392 00000100:00100000:2.0:1784938117.684959:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499392 00000100:00100000:2.0:1784938117.684991:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 48 00000100:00100000:2.0:1784938117.684998:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065499392:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.685029:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065499392:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.685035:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 48 00000100:00080000:2.0:1784938117.685048:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938117.685097:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938117.685262:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065499264:192.168.201.158@tcp:400:kworker.0 00010000:00080000:2.0:1784938117.685296:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5258380 x1871643065499392/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938117.685406:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065499392:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938117.686199:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065499648:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.686434:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938117.686459:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938117.686477:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499136 00000100:00100000:2.0:1784938117.686483:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499136 00000100:00100000:2.0:1784938117.686862:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 84 00000100:00100000:2.0:1784938117.686872:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065499136:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.686987:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff834e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065499136:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 116us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.687007:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 84 00000100:00100000:2.0:1784938117.687031:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499648 00000100:00100000:2.0:1784938117.687034:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499648 00000100:00100000:2.0:1784938117.687239:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 49 00000100:00100000:2.0:1784938117.687247:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065499648:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938117.687273:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065499648:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 29us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938117.687280:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 49 00000100:00080000:2.0:1784938117.687300:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938117.688046:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065499136:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938117.688179:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af525ad80 x1871643065499648/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938133 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938117.688190:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065499648:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938117.688509:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065499008:0@lo:400:kworker.0 00000100:00100000:2.0:1784938117.688825:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938117.688924:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499520 00000100:00100000:3.0:1784938117.688931:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499520 00000100:00100000:3.0:1784938117.688995:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 85 00000100:00100000:3.0:1784938117.689004:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065499520:12345-192.168.201.158@tcp:400:kworker.0 00000100:00080000:2.0:1784938117.689041:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938117.689069:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff837800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065499520:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 65us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938117.689078:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 85 00000100:00100000:0.0:1784938117.689427:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065499520:192.168.201.158@tcp:400:kworker.0 00010000:00010000:1.0:1784938118.006487:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938118.069995:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938118.070190:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687360 00000100:00100000:3.0:1784938118.070202:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687360 00000100:00100000:3.0:1784938118.070322:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:3.0:1784938118.070335:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048687360:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938118.070417:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048687360:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 86us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938118.070425:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00080000:1.0:1784938118.071000:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938118.079784:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938118.079824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938118.079869:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938118.079900:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938118.079933:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687232 00000100:00100000:3.0:1784938118.079944:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687232 00000100:00100000:3.0:1784938118.079996:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:3.0:1784938118.080006:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048687232:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938118.080098:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048687232:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938118.080107:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:3.0:1784938118.080143:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687488 00000100:00100000:3.0:1784938118.080146:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687488 00000100:00100000:3.0:1784938118.080187:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1784938118.080195:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048687488:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938118.080256:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048687488:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 62us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938118.080263:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00080000:3.0:1784938118.080386:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938118.080688:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687616 00000100:00100000:0.0:1784938118.080694:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687616 00000100:00100000:0.0:1784938118.080738:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687744 00000100:00100000:0.0:1784938118.080741:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687744 00000100:00100000:0.0:1784938118.080762:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938118.080769:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2354:x1871643048687616:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:0.0:1784938118.080792:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec37a8 00000100:00080000:0.0:1784938118.080801:0:6604:0:(import.c:65:import_set_state_nolock()) ffffa05ae1724000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938118.080855:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784938118.082267:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1784938118.082287:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2354:x1871643048687744:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:2.0:1784938118.082318:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec37af 00000100:00080000:2.0:1784938118.082346:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ae1726000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1784938118.082383:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1784938118.082865:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+2:2354:x1871643048687744:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 585us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938118.082874:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:2.0:1784938118.082996:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938118.083903:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938118.083915:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938118.084960:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+2:2354:x1871643048687616:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 4181us (5176us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938118.084974:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:0.0:1784938118.085018:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938118.193847:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938118.193874:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065499776:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938118.194273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938118.194376:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499776 00000100:00100000:0.0:1784938118.194385:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499776 00000100:00100000:0.0:1784938118.194579:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 41 00000100:00100000:0.0:1784938118.194590:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065499776:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938118.194631:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938118.194675:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065499776:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 87us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938118.194682:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 41 00010000:00080000:3.0:1784938118.195787:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af525a300 x1871643065499776/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938134 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938118.195812:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065499776:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:00100000:1.0:1784938118.787999:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c6a50b74-5d5a-412d-afac-0a1727d8185d 00000020:00000080:1.0:1784938118.788012:0:7507:0:(genops.c:906:class_export_put()) final put ffffa05ae1727800/c6a50b74-5d5a-412d-afac-0a1727d8185d 00000020:00000080:0.0:1784938118.788299:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1727800/c6a50b74-5d5a-412d-afac-0a1727d8185d for lustre-OST0001 00000020:00000080:0.0:1784938118.788360:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ae1726000 for lustre-OST0001 00010000:00010000:2.0:1784938119.025478:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938120.050614:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938120.761751:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065499904:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938120.764159:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938120.765875:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065499904 00000100:00100000:0.0:1784938120.765895:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065499904 00000100:00100000:0.0:1784938120.766010:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 42 00000100:00100000:0.0:1784938120.766022:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065499904:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938120.766071:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938120.766161:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065499904:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 141us (2014us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938120.766170:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 42 00000100:00080000:0.0:1784938120.766195:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1784938120.774099:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac8228000 x1871643065499904/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938120.774133:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065499904:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:00100000:3.0:1784938120.848033:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c6a50b74-5d5a-412d-afac-0a1727d8185d 00000020:00000080:3.0:1784938120.848048:0:6628:0:(genops.c:906:class_export_put()) final put ffffa05ae1723800/c6a50b74-5d5a-412d-afac-0a1727d8185d 00000020:00000080:2.0:1784938120.848298:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1723800/c6a50b74-5d5a-412d-afac-0a1727d8185d for lustre-OST0000 00000020:00000080:2.0:1784938120.848423:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ae1724000 for lustre-OST0000 00010000:00010000:2.0:1784938121.073403:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938122.101299:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938122.600888:0:10884:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1784938122.812554:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065500416:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.812690:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1784938122.812707:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065500032:0@lo:400:kworker.0 00000100:00100000:0.0:1784938122.812769:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938122.812803:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065500544:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.812845:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065500160:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.812871:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065500672:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.812894:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938122.812900:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065500288:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.813098:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938122.813154:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938122.813177:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938122.813196:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938122.813235:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938122.813261:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500032 00000100:00100000:0.0:1784938122.813268:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500032 00000100:00100000:0.0:1784938122.813319:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784938122.813328:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065500032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938122.813382:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065500032:12345-0@lo:400:kworker.0 Request processed in 55us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.813390:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1784938122.813432:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500544 00000100:00100000:0.0:1784938122.813436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500544 00000100:00100000:0.0:1784938122.813468:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500160 00000100:00100000:0.0:1784938122.813471:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500160 00000100:00100000:0.0:1784938122.813481:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500288 00000100:00100000:0.0:1784938122.813483:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500288 00000100:00100000:0.0:1784938122.813497:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 88 00000100:00100000:0.0:1784938122.813512:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065500544:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.813548:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065500544:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 37us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.813555:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 88 00000100:00100000:0.0:1784938122.813567:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 89 00000100:00100000:0.0:1784938122.813573:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065500160:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.813596:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065500160:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.813601:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 89 00000100:00100000:0.0:1784938122.813613:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 90 00000100:00100000:0.0:1784938122.813619:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065500288:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.813640:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065500288:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 21us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.813645:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 90 00000100:00100000:0.0:1784938122.813664:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500672 00000100:00100000:0.0:1784938122.813667:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500672 00000100:00100000:0.0:1784938122.813692:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500416 00000100:00100000:0.0:1784938122.813695:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500416 00000100:00100000:0.0:1784938122.813715:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 50 00000100:00100000:0.0:1784938122.813721:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065500672:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.813745:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065500672:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.813764:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 50 00000100:00100000:0.0:1784938122.813775:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 51 00000100:00100000:0.0:1784938122.813781:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065500416:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.813813:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065500416:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938122.813819:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 51 00000100:00080000:0.0:1784938122.813847:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938122.813851:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938122.813854:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938122.814029:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065500288:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.814041:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065500160:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938122.814054:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05b01fd1500 x1871643065500672/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938122.814064:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065500672:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938122.814102:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065500032:0@lo:400:kworker.0 00000100:00100000:0.0:1784938122.814114:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065500544:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938122.814124:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05b01fd3800 x1871643065500416/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938138 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938122.814132:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065500416:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938123.121897:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938123.186993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938123.187042:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938123.187087:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938123.187203:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688128 00000100:00100000:2.0:1784938123.187262:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688128 00000100:00100000:2.0:1784938123.187345:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688000 00000100:00100000:2.0:1784938123.187349:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688000 00000100:00100000:2.0:1784938123.187377:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784938123.187387:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048688128:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938123.187496:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048688128:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 109us (452us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938123.187505:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784938123.187524:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:2.0:1784938123.187531:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048688000:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938123.187559:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048688000:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938123.187566:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00080000:0.0:1784938123.187829:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938123.188309:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048687872 00000100:00100000:3.0:1784938123.188317:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048687872 00000100:00100000:3.0:1784938123.188363:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:3.0:1784938123.188371:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048687872:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938123.188513:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048687872:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 142us (1536us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938123.188521:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:0.0:1784938123.313673:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065500800:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938123.314442:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938123.318390:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500800 00000100:00100000:2.0:1784938123.318423:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500800 00000100:00100000:2.0:1784938123.318516:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 43 00000100:00100000:2.0:1784938123.318529:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065500800:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938123.318589:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938123.318876:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065500800:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 348us (4437us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938123.318885:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 43 00010000:00080000:2.0:1784938123.319647:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5259180 x1871643065500800/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938139 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938123.319925:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065500800:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938124.145462:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938125.170008:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938125.874745:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938125.874782:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065500928:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938125.875258:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938125.875304:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065500928 00000100:00100000:3.0:1784938125.875316:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065500928 00000100:00100000:3.0:1784938125.875393:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 44 00000100:00100000:3.0:1784938125.875403:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065500928:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938125.875458:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784938125.875481:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938125.875514:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065500928:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 111us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938125.875522:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 44 00010000:00080000:1.0:1784938125.875756:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822bb80 x1871643065500928/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938141 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938125.875790:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065500928:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938126.198542:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1784938126.577164:0:11033:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1244c2f0 20000000:00000080:1.0:1784938126.577188:0:11033:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa05aff9d4c00 uarg=0000000000000000 20000000:01000000:1.0:1784938126.577270:0:11033:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938126.577277:0:11033:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1784938126.577283:0:11033:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1784938126.580040:0:11034:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1784938126.580350:0:11033:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1784938126.596035:0:11033:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1784938126.596407:0:11033:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596434:0:11033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec375b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596443:0:11033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3769 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596451:0:11033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3777 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596463:0:11033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596470:0:11033:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596478:0:11033:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596541:0:11033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 12 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596557:0:11033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 12 pid: 5799 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.596595:0:11033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff834a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501056:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938126.596746:0:11033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596754:0:11033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 12 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.596773:0:11033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501184:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938126.596807:0:11033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3777 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596815:0:11033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3777 expref: 18 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.596825:0:11033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff836300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501312:0@lo:104: 00000100:00100000:2.0:1784938126.596879:0:11033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938126.596924:0:11033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec3769 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596932:0:11033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec3769 expref: 18 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.596939:0:11033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501440:0@lo:104: 00000100:00100000:2.0:1784938126.596960:0:11033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938126.596982:0:11033:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec375b expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.596990:0:11033:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec375b expref: 18 pid: 5797 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.597007:0:11033:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501568:0@lo:104: 00000100:00100000:2.0:1784938126.597030:0:11033:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938126.597041:0:11033:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae13ac780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938126.597259:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065501312 00000100:00100000:0.0:1784938126.597269:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065501312 00000100:00100000:0.0:1784938126.597320:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065501440 00000100:00100000:0.0:1784938126.597323:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065501440 00000100:00100000:0.0:1784938126.597335:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065501568 00000100:00100000:0.0:1784938126.597337:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065501568 00000100:00100000:0.0:1784938126.597362:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938126.597374:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:11033:x1871643065501312:12345-0@lo:104: 00010000:00010000:0.0:1784938126.597389:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597457:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938126.597464:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+5:11033:x1871643065501312:12345-0@lo:104: Request processed in 93us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.597471:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1784938126.597489:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938126.597495:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:11033:x1871643065501440:12345-0@lo:104: 00010000:00010000:0.0:1784938126.597502:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597534:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784938126.597539:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:11033:x1871643065501440:12345-0@lo:104: Request processed in 45us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.597545:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938126.597556:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938126.597562:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:11033:x1871643065501568:12345-0@lo:104: 00010000:00010000:0.0:1784938126.597570:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597607:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784938126.597612:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:11033:x1871643065501568:12345-0@lo:104: Request processed in 51us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.597618:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1784938126.597637:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1784938126.597644:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597652:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1784938126.597657:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597667:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938126.597676:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938126.597691:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938126.597729:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597736:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938126.597760:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597780:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac8991400/0xea86628a8aec3777 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec377e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597810:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1784938126.597814:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597820:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1784938126.597823:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597830:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938126.597836:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938126.597841:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938126.597855:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597861:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938126.597880:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597886:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05afc892000/0xea86628a8aec3769 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3770 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597896:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938126.597899:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597914:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1784938126.597917:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597924:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938126.597930:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938126.597934:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938126.597948:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597954:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938126.597960:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597966:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11b400/0xea86628a8aec375b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec3762 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.597986:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938126.597987:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938126.597989:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938126.597998:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938126.598023:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065501696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938126.598066:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938126.598117:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065501824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938126.598150:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938126.598182:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938126.598188:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065501952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938126.598208:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938126.598288:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065501696 00000100:00100000:0.0:1784938126.598294:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065501696 00010000:00010000:0.0:1784938126.598317:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3777 expref: 19 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938126.598344:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065501824 00000100:00100000:0.0:1784938126.598348:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065501824 00010000:00010000:0.0:1784938126.598359:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3769 expref: 20 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938126.598368:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065501952 00000100:00100000:0.0:1784938126.598370:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065501952 00010000:00010000:0.0:1784938126.598379:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec375b expref: 21 pid: 5797 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938126.598390:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938126.598397:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+21:3322:x1871643065501696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938126.598410:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938126.598415:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3777 expref: 21 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.598425:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3777 expref: 21 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.598444:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938126.598474:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+21:3322:x1871643065501696:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.598488:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938126.598534:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938126.598541:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3323:x1871643065501824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938126.598548:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938126.598553:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec3769 expref: 20 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.598562:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec3769 expref: 20 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.598572:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938126.598597:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3323:x1871643065501824:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.598603:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938126.598615:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938126.598620:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065501952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938126.598627:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938126.598631:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec375b expref: 19 pid: 5797 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.598638:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec375b expref: 19 pid: 5797 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.598646:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938126.598666:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065501952:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.598671:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938126.598733:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065501696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938126.598779:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065501952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938126.598787:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065501824:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938126.602653:0:11033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11b000/0xea86628a8aec377e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3777 expref: 18 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.602692:0:11033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff836300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501312:0@lo:104: 00010000:00010000:2.0:1784938126.602711:0:11033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05b021ee200/0xea86628a8aec3770 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec3769 expref: 17 pid: 5799 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.602722:0:11033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501440:0@lo:104: 00010000:00010000:2.0:1784938126.602735:0:11033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11a400/0xea86628a8aec3762 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec375b expref: 16 pid: 5797 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.602746:0:11033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501568:0@lo:104: 00000100:00100000:0.0:1784938126.604204:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938126.604334:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938126.605342:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688256 00000100:00100000:1.0:1784938126.605359:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688256 00010000:00010000:1.0:1784938126.605429:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 13 pid: 5799 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938126.605478:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688384 00000100:00100000:1.0:1784938126.605481:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688384 00010000:00010000:1.0:1784938126.605496:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 14 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938126.605520:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:1.0:1784938126.605531:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+14:2357:x1871643048688256:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938126.605552:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938126.605558:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 14 pid: 5799 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938126.605574:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 14 pid: 5799 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938126.605622:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938126.605711:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+14:2357:x1871643048688256:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 181us (1519us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938126.605746:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784938126.606079:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784938126.606090:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048688384:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938126.606100:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938126.606106:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 13 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606116:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 13 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606131:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606141:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606163:0:8373:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606171:0:8373:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606178:0:8373:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606199:0:8373:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606205:0:8373:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938126.606210:0:8373:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606245:0:8373:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606256:0:8373:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938126.606268:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938126.606299:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048688384:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 213us (1965us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938126.606306:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00010000:00010000:2.0:1784938126.609935:0:11033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892600/0xea86628a8aec379a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897801 expref: 12 pid: 5799 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.609961:0:11033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff834a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501056:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938126.610138:0:11033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05aff87c800/0xea86628a8aec3785 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c9 expref: 11 pid: 5797 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938126.610148:0:11033:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11033:1871643065501184:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938126.610188:0:11033:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.610199:0:11033:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.610429:0:11033:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938126.610436:0:11033:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893e00/0xea86628a8aec37b6 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938127.217911:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938127.921977:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938127.921987:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac7f16000 from 7 10000000:01000000:3.0:1784938127.921993:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938127.922058:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.922073:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.922087:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938127.922121:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065502080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.922253:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.922315:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938127.923476:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502080 00000100:00100000:0.0:1784938127.923494:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502080 00000100:00100000:0.0:1784938127.923573:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1784938127.923585:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065502080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938127.923608:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938127.923632:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec37bd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938127.923674:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec37bd expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938127.923703:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec37bd expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938127.923716:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031200, rc 0) 00000100:00100000:0.0:1784938127.923806:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065502080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.923815:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1784938127.924006:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065502080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938127.924026:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.924037:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938127.924115:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065502208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.924154:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.924196:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938127.926123:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502208 00000100:00100000:0.0:1784938127.926135:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502208 00000100:00100000:0.0:1784938127.926201:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784938127.926236:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065502208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938127.926607:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065502208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 395us (2450us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.926617:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1784938127.926688:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065502336:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938127.927474:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065502208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.927537:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee076680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065502976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.927600:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.927643:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938127.927680:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502976 00000100:00100000:3.0:1784938127.927695:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502976 00000100:00100000:3.0:1784938127.927754:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784938127.927763:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065502976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.927957:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065502976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938127.927965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1784938127.928010:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee076680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065502976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938127.928245:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065502848:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.928307:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938127.928316:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065502464:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938127.929039:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938127.929140:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938127.929177:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502336 00000100:00100000:3.0:1784938127.929185:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502336 00000100:00100000:3.0:1784938127.929257:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 93 00000100:00100000:3.0:1784938127.929267:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065502336:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938127.929325:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065502336:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 60us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938127.929343:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 93 00000100:00100000:0.0:1784938127.935065:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065502336:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.935151:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065502592:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.935208:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938127.935234:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065502720:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.935646:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938127.935706:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938127.935726:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938127.935774:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502848 00000100:00100000:0.0:1784938127.935784:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502848 00000100:00100000:0.0:1784938127.935854:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502592 00000100:00100000:0.0:1784938127.935859:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502592 00000100:00100000:0.0:1784938127.935888:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 52 00000100:00100000:0.0:1784938127.935898:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065502848:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.935974:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065502848:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 76us (6833us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.935982:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 52 00000100:00100000:0.0:1784938127.936001:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:0.0:1784938127.936007:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065502592:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.936032:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065502592:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.936037:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:0.0:1784938127.936058:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502464 00000100:00100000:0.0:1784938127.936062:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502464 00000100:00100000:0.0:1784938127.936086:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065502720 00000100:00100000:0.0:1784938127.936089:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065502720 00000100:00100000:0.0:1784938127.936103:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 94 00000100:00100000:0.0:1784938127.936109:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065502464:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.936139:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065502464:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 30us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.936145:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 94 00000100:00100000:0.0:1784938127.936156:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 95 00000100:00100000:0.0:1784938127.936162:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065502720:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.936193:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065502720:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 31us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.936201:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 95 00000100:00080000:0.0:1784938127.936254:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938127.936259:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938127.936261:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938127.936427:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065502720:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938127.936445:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822bb80 x1871643065502592/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938127.936457:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065502592:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938127.936502:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065502464:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938127.936515:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aee076d80 x1871643065502848/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938127.936525:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee076d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065502848:192.168.201.158@tcp:400:kworker.0 00000040:00080000:0.0:1784938127.939187:0:11069:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784938127.939643:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784938127.939679:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938127.939694:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.939709:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938127.939722:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938127.939725:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac73fb000 from 7 10000000:01000000:3.0:1784938127.939729:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938127.939811:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.939820:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.939833:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938127.939866:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.939954:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.940018:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938127.940071:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503104 00000100:00100000:2.0:1784938127.940082:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503104 00000100:00100000:2.0:1784938127.940137:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1784938127.940148:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065503104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938127.940164:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938127.940181:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec37cb expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938127.940211:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec37cb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938127.940242:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec37cb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938127.940252:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892000, rc 0) 00000100:00100000:2.0:1784938127.940297:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065503104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938127.940304:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1784938127.949641:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938127.949702:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.949722:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938127.951089:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.951185:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.951261:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938127.954759:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503232 00000100:00100000:0.0:1784938127.954783:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503232 00000100:00100000:0.0:1784938127.954866:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1784938127.954879:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065503232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938127.955305:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065503232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 428us (4120us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938127.955315:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1784938127.955825:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.955912:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.955992:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.956036:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938127.956058:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503360 00000100:00100000:3.0:1784938127.956071:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503360 00000100:00100000:3.0:1784938127.956113:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784938127.956122:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.956884:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 759us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938127.956896:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1784938127.956973:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938127.958002:0:11071:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1784938127.958096:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1784938127.958116:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938127.958129:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.958142:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938127.958156:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938127.958159:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac735f800 from 7 10000000:01000000:3.0:1784938127.958162:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938127.958212:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.958249:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.958261:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938127.958289:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503488:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.963873:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.963945:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938127.964025:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503488 00000100:00100000:2.0:1784938127.964037:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503488 00000100:00100000:2.0:1784938127.964104:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1784938127.964116:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065503488:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938127.964152:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938127.964178:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec37d9 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938127.964253:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938127.964268:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 19 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938127.964280:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938127.964979:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503488:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 861us (1112us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938127.964989:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1784938127.965100:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503488:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938127.965124:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938127.965138:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938127.965387:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.965435:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.965470:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938127.965886:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503616 00000100:00100000:2.0:1784938127.965897:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503616 00000100:00100000:2.0:1784938127.965949:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1784938127.965958:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503616:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938127.966304:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503616:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 346us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938127.966312:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1784938127.971514:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503616:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.971592:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503744:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938127.971696:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938127.971765:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8804780 going to sleep for 11 seconds 00000100:00100000:1.0:1784938127.974121:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503744 00000100:00100000:1.0:1784938127.974147:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503744 00000100:00100000:1.0:1784938127.974245:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1784938127.974258:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503744:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938127.974589:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065503744:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 332us (2892us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938127.974599:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1784938127.975610:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065503744:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938127.977176:0:11073:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1784938127.978059:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1784938127.978085:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938127.978099:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938127.978114:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938128.114864:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938128.115254:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688512 00000100:00100000:2.0:1784938128.115271:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688512 00000100:00100000:2.0:1784938128.115366:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:2.0:1784938128.115379:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:5573:x1871643048688512:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938128.115404:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938128.115432:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89782b expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938128.115494:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938128.115510:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938128.115524:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938128.115592:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048688512:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 216us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938128.115600:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:3.0:1784938128.122676:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938128.122775:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688640 00000100:00100000:2.0:1784938128.122790:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688640 00000100:00100000:2.0:1784938128.122866:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:2.0:1784938128.122879:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048688640:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938128.123254:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048688640:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 376us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938128.123264:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:0.0:1784938128.129968:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938128.144400:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688768 00000100:00100000:3.0:1784938128.144422:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688768 00000100:00100000:3.0:1784938128.144514:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 242 00000100:00100000:3.0:1784938128.144527:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048688768:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938128.144862:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048688768:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 336us (14909us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938128.144879:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 242 00000100:00100000:0.0:1784938128.151158:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938128.151948:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048688896 00000100:00100000:3.0:1784938128.151963:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048688896 00000100:00100000:3.0:1784938128.152046:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 243 00000100:00100000:3.0:1784938128.152059:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048688896:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938128.152083:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938128.152108:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897832 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938128.152148:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938128.152162:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938128.152173:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c200, rc 0) 00000100:00100000:3.0:1784938128.152268:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048688896:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 211us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938128.152275:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 243 00000100:00100000:3.0:1784938128.157899:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938128.157995:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689024 00000100:00100000:1.0:1784938128.158010:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689024 00000100:00100000:1.0:1784938128.158082:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 244 00000100:00100000:1.0:1784938128.158095:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048689024:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938128.159959:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048689024:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 1854us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938128.159973:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 244 00000100:00100000:3.0:1784938128.162142:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938128.162260:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689152 00000100:00100000:1.0:1784938128.162273:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689152 00000100:00100000:1.0:1784938128.162342:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 245 00000100:00100000:1.0:1784938128.162370:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048689152:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938128.162646:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048689152:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 278us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938128.162669:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 245 00010000:00010000:1.0:1784938128.263840:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938128.314998:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938128.315048:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938128.315090:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689280 00000100:00100000:2.0:1784938128.315103:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689280 00000100:00100000:2.0:1784938128.315181:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689408 00000100:00100000:2.0:1784938128.315184:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689408 00000100:00100000:2.0:1784938128.315212:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:2.0:1784938128.315246:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048689280:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938128.315359:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048689280:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 115us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938128.315385:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:2.0:1784938128.315406:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:2.0:1784938128.315412:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048689408:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938128.315444:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048689408:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938128.315450:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00080000:2.0:1784938128.315469:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938128.434354:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938128.434388:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065503872:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938128.435132:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938128.435272:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065503872 00000100:00100000:3.0:1784938128.435285:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065503872 00000100:00100000:3.0:1784938128.435394:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 45 00000100:00100000:3.0:1784938128.435405:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065503872:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938128.435466:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938128.435562:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065503872:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 158us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938128.435571:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 45 00010000:00080000:3.0:1784938128.439944:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5259180 x1871643065503872/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938144 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938128.439979:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065503872:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:0.0:1784938129.265558:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938130.289464:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938130.994521:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938130.994557:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065504000:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938130.994928:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938130.994962:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504000 00000100:00100000:0.0:1784938130.994971:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504000 00000100:00100000:0.0:1784938130.995034:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 46 00000100:00100000:0.0:1784938130.995044:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065504000:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938130.995088:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938130.995136:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065504000:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 93us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938130.995145:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 46 00010000:00080000:0.0:1784938130.995428:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb1f80 x1871643065504000/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938146 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938130.995451:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065504000:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:2.0:1784938130.995542:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938131.318808:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938131.477167:0:11230:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938132.339033:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938133.048457:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065504128:0@lo:400:kworker.0 00000100:00100000:3.0:1784938133.048554:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938133.048640:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065504640:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.048787:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938133.048795:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065504512:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.048846:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065504256:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.048873:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065504768:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.048896:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938133.048901:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065504384:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.049146:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938133.049205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938133.049256:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938133.049278:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938133.049297:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938133.049329:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504512 00000100:00100000:3.0:1784938133.049352:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504512 00000100:00100000:3.0:1784938133.049417:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504768 00000100:00100000:3.0:1784938133.049421:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504768 00000100:00100000:3.0:1784938133.049446:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 54 00000100:00100000:3.0:1784938133.049457:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065504512:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.049514:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065504512:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 59us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938133.049523:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 54 00000100:00100000:3.0:1784938133.049542:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 55 00000100:00100000:3.0:1784938133.049549:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065504768:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.049586:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065504768:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938133.049593:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 55 00000100:00100000:3.0:1784938133.049614:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504640 00000100:00100000:3.0:1784938133.049618:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504640 00000100:00100000:3.0:1784938133.049645:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504256 00000100:00100000:3.0:1784938133.049648:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504256 00000100:00100000:3.0:1784938133.050161:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504384 00000100:00100000:3.0:1784938133.050166:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504384 00000100:00100000:3.0:1784938133.050186:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 98 00000100:00100000:3.0:1784938133.050194:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065504640:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.050260:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065504640:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 66us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938133.050267:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 98 00000100:00100000:3.0:1784938133.050281:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 99 00000100:00100000:3.0:1784938133.050287:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065504256:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.050334:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065504256:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 47us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938133.050340:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 99 00000100:00100000:3.0:1784938133.050352:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 100 00000100:00100000:3.0:1784938133.050358:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065504384:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.050381:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065504384:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938133.050387:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 100 00000100:00080000:3.0:1784938133.050415:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938133.050421:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938133.050423:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784938133.052828:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aee077480 x1871643065504512/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938133.052852:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065504512:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.052870:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065504640:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.052916:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee076a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065504384:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.052929:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee075180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065504256:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938133.052942:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aee077800 x1871643065504768/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938149 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938133.052951:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065504768:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938133.053799:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504128 00000100:00100000:1.0:1784938133.053811:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504128 00000100:00100000:1.0:1784938133.053893:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1784938133.053905:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065504128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938133.054029:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065504128:12345-0@lo:400:kworker.0 Request processed in 125us (5473us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938133.054038:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1784938133.054696:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065504128:0@lo:400:kworker.0 00010000:00010000:0.0:1784938133.361452:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938133.434962:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938133.435006:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938133.435046:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938133.435121:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689664 00000100:00100000:0.0:1784938133.435136:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689664 00000100:00100000:0.0:1784938133.435249:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689792 00000100:00100000:0.0:1784938133.435252:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689792 00000100:00100000:0.0:1784938133.435279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:0.0:1784938133.435289:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048689664:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938133.435381:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048689664:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938133.435404:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:0.0:1784938133.435423:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:0.0:1784938133.435429:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048689792:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938133.435457:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048689792:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938133.435463:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00080000:2.0:1784938133.435614:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938133.436587:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689536 00000100:00100000:3.0:1784938133.436615:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689536 00000100:00100000:3.0:1784938133.439181:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 247 00000100:00100000:3.0:1784938133.439206:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048689536:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938133.443067:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048689536:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 3847us (8095us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938133.443089:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 247 00000100:00100000:3.0:1784938133.555685:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065504896:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938133.556135:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938133.558164:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065504896 00000100:00100000:2.0:1784938133.558183:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065504896 00000100:00100000:2.0:1784938133.558292:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 47 00000100:00100000:2.0:1784938133.558303:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065504896:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938133.558356:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938133.558438:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065504896:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 138us (2306us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938133.558445:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 47 00010000:00080000:3.0:1784938133.558970:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822ce00 x1871643065504896/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938149 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938133.558998:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065504896:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938134.386609:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938135.180919:0:11331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 20:08:54 (1784938134) === 00010000:00010000:0.0:1784938135.409640:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938135.442911:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.442965:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938135.443108:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048690048 00000100:00100000:2.0:1784938135.443121:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048690048 00000100:00100000:2.0:1784938135.444161:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1784938135.444181:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:9651:x1871643048690048:12345-192.168.201.58@tcp:700:mkdir.0 00000100:00100000:2.0:1784938135.444347:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:9651:x1871643048690048:12345-192.168.201.58@tcp:700:mkdir.0 Request processed in 174us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938135.444355:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00080000:1.0:1784938135.445954:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938135.447183:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048689920 00000100:00100000:0.0:1784938135.447334:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048689920 00000100:00100000:0.0:1784938135.447486:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938135.447499:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048689920:12345-192.168.201.58@tcp:41:mkdir.0 00000004:00000024:0.0:1784938135.447588:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784938135.447719:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048689920:12345-192.168.201.58@tcp:41:mkdir.0 Request processed in 222us (4751us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.447728:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1784938135.451418:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.451931:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048690304 00000100:00100000:0.0:1784938135.451946:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048690304 00000100:00100000:0.0:1784938135.452020:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784938135.452031:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:9651:x1871643048690304:12345-192.168.201.58@tcp:36:mkdir.0 00010000:00010000:0.0:1784938135.452118:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938135.452431:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec36d6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977b4 expref: 6 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.452465:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861400) 00010000:00010000:0.0:1784938135.452480:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938135.454288:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.454316:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.454340:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.455188:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.455205:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.455307:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938135.459463:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784938135.459488:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.459499:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.459507:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.459514:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938135.459520:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.459529:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.459567:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac30f8300) 00010000:00010000:0.0:1784938135.459570:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938135.459576:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.459583:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec37f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938135.459606:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000246e1f1c reply state 00000000cf8780b7 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938135.459617:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938135.459738:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff834a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9651:x1871643048690304:12345-192.168.201.58@tcp:36:mkdir.0 Request processed in 7704us (8331us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1784938135.459748:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:1.0:1784938135.463926:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.463951:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.463959:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.463965:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.463971:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.464000:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.464027:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938135.464031:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.464038:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.464045:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec37fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938135.483820:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.484606:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048690432 00000100:00100000:3.0:1784938135.484688:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048690432 00000100:00100000:3.0:1784938135.484828:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1784938135.484854:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:9652:x1871643048690432:12345-192.168.201.58@tcp:101:chmod.0 00010000:00010000:3.0:1784938135.484881:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938135.484921:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897839 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.485019:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec380a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.485038:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.485072:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938135.485152:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784938135.485157:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938135.485204:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec380a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.485738:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897839 expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.485760:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec380a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897839 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.485771:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:3.0:1784938135.485774:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938135.485779:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d600, rc 0) 00000100:00100000:3.0:1784938135.485868:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9652:x1871643048690432:12345-192.168.201.58@tcp:101:chmod.0 Request processed in 1030us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.485876:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784938135.488486:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.488585:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048690688 00000100:00100000:3.0:1784938135.488595:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048690688 00000100:00100000:3.0:1784938135.488930:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1784938135.488942:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9652:x1871643048690688:12345-192.168.201.58@tcp:36:chmod.0 00010000:00010000:3.0:1784938135.489012:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938135.489040:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec380a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897839 expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.489082:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:3.0:1784938135.489096:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938135.489124:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.489137:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.489147:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938135.489813:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ff875783 reply state 000000001d2cf577 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938135.489827:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784938135.489844:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1784938135.489936:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:9652:x1871643048690688:12345-192.168.201.58@tcp:36:chmod.0 Request processed in 996us (1459us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1784938135.491826:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00010000:00010000:1.0:1784938135.492708:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.492722:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.492730:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.492737:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.492741:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.492750:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.492765:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861800) 00010000:00010000:1.0:1784938135.492768:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938135.492773:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.492798:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3811 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938135.521642:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.522358:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048690816 00000100:00100000:1.0:1784938135.522370:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048690816 00000100:00100000:1.0:1784938135.522440:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784938135.522451:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9654:x1871643048690816:12345-192.168.201.58@tcp:101:chown.0 00010000:00010000:1.0:1784938135.522476:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938135.522503:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec3818 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897840 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.522590:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec381f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.522606:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec381f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.522618:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec381f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938135.522685:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1784938135.522689:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938135.522744:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec381f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.522775:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec3818 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897840 expref: 9 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.522807:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec381f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897840 expref: 8 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.522832:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:1.0:1784938135.522836:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938135.522840:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990600, rc 0) 00000100:00100000:1.0:1784938135.523410:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:9654:x1871643048690816:12345-192.168.201.58@tcp:101:chown.0 Request processed in 959us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938135.523419:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1784938135.545497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.550306:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048690944 00000100:00100000:0.0:1784938135.550392:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048690944 00000100:00100000:0.0:1784938135.551536:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784938135.551558:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:9654:x1871643048690944:12345-192.168.201.58@tcp:101:chown.0 00010000:00010000:0.0:1784938135.551584:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938135.551609:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3826 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897847 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551679:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551693:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551718:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551740:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551748:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551755:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551870:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030800/0xea86628a8aec383b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551879:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030800/0xea86628a8aec383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551886:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030800/0xea86628a8aec383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938135.551926:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784938135.551930:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938135.551959:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030800/0xea86628a8aec383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551971:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551978:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.551994:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552000:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938135.552705:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552716:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552729:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:0.0:1784938135.552733:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938135.552737:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552743:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec382d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552759:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552766:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552771:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552777:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938135.552780:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552800:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552809:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa05ac30f8300) 00010000:00010000:0.0:1784938135.552811:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938135.552815:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552820:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec3834 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552859:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3826 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897847 expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552874:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030800/0xea86628a8aec383b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897847 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.552881:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ac30f8000) 00010000:00010000:0.0:1784938135.552883:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938135.552886:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030800, rc 0) 00000100:00100000:0.0:1784938135.552974:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:9654:x1871643048690944:12345-192.168.201.58@tcp:101:chown.0 Request processed in 1424us (7485us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.552982:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784938135.562830:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938135.577995:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048691200 00000100:00100000:2.0:1784938135.578023:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048691200 00000100:00100000:2.0:1784938135.578112:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1784938135.578122:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:9654:x1871643048691200:12345-192.168.201.58@tcp:36:chown.0 00010000:00010000:2.0:1784938135.578180:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938135.578208:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030800/0xea86628a8aec383b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897847 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.578251:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ac30f8000) 00010000:00010000:2.0:1784938135.578264:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938135.578292:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.578307:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.578318:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938135.649599:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:3.0:1784938135.650163:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1784938135.650439:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb4b932e reply state 00000000531cdefc transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938135.650473:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1784938135.651082:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:3.0:1784938135.651267:0:5804:0:(ldlm_lib.c:3477:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1784938135.651290:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9654:x1871643048691200:12345-192.168.201.58@tcp:36:chown.0 Request processed in 73165us (88465us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1784938135.651301:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00010000:00010000:1.0:1784938135.651474:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.651484:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.651492:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.651499:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.651504:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.651511:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.651952:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886b000) 00010000:00010000:1.0:1784938135.651955:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938135.651961:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.651968:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3842 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938135.686074:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938135.690648:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048691328 00000100:00100000:2.0:1784938135.690667:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048691328 00000100:00100000:2.0:1784938135.690763:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:2.0:1784938135.690775:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:9655:x1871643048691328:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:2.0:1784938135.690806:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938135.690831:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3849 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89784e expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938135.695932:0:7211:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5041us 00010000:00010000:2.0:1784938135.738976:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.739003:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.739016:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.739034:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.739042:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.739048:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.740684:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec385e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.740708:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec385e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.740978:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec385e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938135.741084:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938135.741089:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938135.741184:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec385e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.741199:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.741206:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.742607:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.742623:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938135.742628:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.742638:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.742656:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:2.0:1784938135.742659:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938135.742664:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.742686:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3850 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744046:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744064:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744072:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744077:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938135.744081:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744088:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744101:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa05ad886b300) 00010000:00010000:2.0:1784938135.744104:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938135.744108:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744114:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3857 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744173:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3849 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89784e expref: 8 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744190:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec385e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89784e expref: 7 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938135.744208:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938135.744211:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938135.744228:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892600, rc 0) 00000100:00100000:2.0:1784938135.744302:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9655:x1871643048691328:12345-192.168.201.58@tcp:101:touch.500 Request processed in 53528us (58238us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938135.744311:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1784938135.750426:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.750581:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048691584 00000100:00100000:3.0:1784938135.750593:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048691584 00000100:00100000:3.0:1784938135.750664:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:3.0:1784938135.750676:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9655:x1871643048691584:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:3.0:1784938135.750702:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938135.750738:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3865 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897855 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.751100:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.751118:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.751130:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.751166:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.751175:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.751182:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938135.752338:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1784938135.753172:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec387a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.753189:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.753210:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec387a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755834:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755852:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755860:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755867:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.755871:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755880:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755897:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938135.755900:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.755905:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.755911:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec386c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938135.755928:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000054b49fd reply state 00000000debe32bc transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938135.755939:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938135.755990:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3865 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897855 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.756025:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec387a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897855 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.756033:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac3861300) 00010000:00010000:1.0:1784938135.756035:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938135.756037:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c600, rc 0) 00000100:00100000:1.0:1784938135.756112:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:9655:x1871643048691584:12345-192.168.201.58@tcp:101:touch.500 Request processed in 5438us (5696us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784938135.756121:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00010000:00010000:1.0:1784938135.759962:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.759981:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.759989:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.759994:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.759999:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.760007:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.760025:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbf4b6a20 (ffffa05ac3861500) 00010000:00010000:1.0:1784938135.760028:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.760033:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.760056:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3873 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938135.765654:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.765733:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048691840 00000100:00100000:0.0:1784938135.765743:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048691840 00000100:00100000:0.0:1784938135.765810:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1784938135.765820:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:9655:x1871643048691840:12345-192.168.201.58@tcp:36:touch.500 00010000:00010000:0.0:1784938135.765885:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938135.765925:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec387a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897855 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.765942:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac3861300) 00010000:00010000:0.0:1784938135.765954:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938135.766001:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.766014:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.766023:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938135.766169:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000500af9a2 reply state 00000000673f832c transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938135.766179:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938135.766304:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:9655:x1871643048691840:12345-192.168.201.58@tcp:36:touch.500 Request processed in 485us (660us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1784938135.766311:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00010000:00010000:1.0:1784938135.769179:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.769199:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.769207:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.769269:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.769276:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.769285:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.769302:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac30f8600) 00010000:00010000:1.0:1784938135.769305:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.769310:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.769316:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3888 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938135.769630:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.769918:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048691968 00000100:00100000:3.0:1784938135.769937:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048691968 00000100:00100000:3.0:1784938135.769990:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1784938135.769999:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:9655:x1871643048691968:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:3.0:1784938135.770025:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938135.770046:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec388f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89785c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.770107:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec388f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89785c expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.770121:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec388f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89785c expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938135.770140:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac3861e00) 00010000:00010000:3.0:1784938135.770143:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938135.770146:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c800, rc 0) 00000100:00100000:3.0:1784938135.770209:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:9655:x1871643048691968:12345-192.168.201.58@tcp:101:touch.500 Request processed in 211us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938135.770236:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1784938135.780634:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.781561:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048692096 00000100:00100000:0.0:1784938135.781574:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048692096 00000100:00100000:0.0:1784938135.781632:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784938135.781640:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1871643048692096:12345-192.168.201.58@tcp:8:touch.500 00010000:00080000:0.0:1784938135.781677:0:6605:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp t0 exp 0000000000000000 cur 344 last 0 00000020:00000080:0.0:1784938135.781725:0:6605:0:(genops.c:1406:class_connect()) connect: client 8bbc0047-63c1-4cac-b5e6-ede401808e2e, cookie 0xea86628a8aec3896 00002000:00100000:0.0:1784938135.781738:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bbc0047-63c1-4cac-b5e6-ede401808e2e/ffffa05b01e06000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784938135.781765:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784938135.782054:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938135.782089:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05b01e00800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938135.782167:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2354:x1871643048692096:12345-192.168.201.58@tcp:8:touch.500 Request processed in 525us (1544us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.782175:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1784938135.789847:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.789921:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048692224 00000100:00100000:3.0:1784938135.789933:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048692224 00000100:00080000:1.0:1784938135.789998:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938135.790016:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1784938135.790039:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:0:x1871643048692224:12345-192.168.201.58@tcp:2:touch.500 00000001:00100000:3.0:1784938135.824734:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000001:00080000:3.0:1784938135.824756:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1784938135.825006:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:0:x1871643048692224:12345-192.168.201.58@tcp:2:touch.500 Request processed in 34963us (35162us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784938135.825018:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:1.0:1784938135.839163:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.839919:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048692480 00000100:00100000:0.0:1784938135.839932:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048692480 00000100:00100000:0.0:1784938135.840006:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784938135.840017:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:9655:x1871643048692480:12345-192.168.201.58@tcp:35:touch.500 00000100:00100000:2.0:1784938135.840943:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:9655:x1871643048692480:12345-192.168.201.58@tcp:35:touch.500 Request processed in 922us (1785us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784938135.840960:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784938135.880372:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.887535:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048692608 00000100:00100000:0.0:1784938135.887555:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048692608 00000100:00100000:0.0:1784938135.887644:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1784938135.887655:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:9656:x1871643048692608:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:0.0:1784938135.887686:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938135.887714:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec389d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897863 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.887796:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec38a4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.887812:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec38a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.887826:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec38a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938135.887899:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784938135.887904:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938135.887944:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec38a4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.887992:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec389d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897863 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.888014:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec38a4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897863 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.888023:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938135.888026:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938135.888029:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938135.888104:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:9656:x1871643048692608:12345-192.168.201.58@tcp:101:rm.0 Request processed in 450us (7743us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.888112:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1784938135.902981:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.903455:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048692864 00000100:00100000:1.0:1784938135.903469:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048692864 00000100:00100000:1.0:1784938135.903546:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:1.0:1784938135.903557:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:9656:x1871643048692864:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:1.0:1784938135.903581:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938135.903607:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec38ab lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89786a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938135.903742:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784938135.903884:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec38ab lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89786a expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.903898:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:1.0:1784938135.903902:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938135.903907:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec38ab lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89786a expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.903935:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990400, rc 0) 00000100:00100000:1.0:1784938135.904009:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:9656:x1871643048692864:12345-192.168.201.58@tcp:101:rm.0 Request processed in 454us (1041us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1784938135.904017:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:1.0:1784938135.910866:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938135.911303:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048692992 00000100:00100000:3.0:1784938135.911314:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048692992 00000100:00100000:3.0:1784938135.911377:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1784938135.911388:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:9656:x1871643048692992:12345-192.168.201.58@tcp:37:rm.0 00000100:00100000:0.0:1784938135.918201:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:9656:x1871643048692992:12345-192.168.201.58@tcp:37:rm.0 Request processed in 6792us (7322us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.918268:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1784938135.924137:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.924739:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048693248 00000100:00100000:1.0:1784938135.924752:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048693248 00000100:00100000:1.0:1784938135.924825:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784938135.924835:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:9656:x1871643048693248:12345-192.168.201.58@tcp:35:rm.0 00000100:00100000:1.0:1784938135.925158:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:9656:x1871643048693248:12345-192.168.201.58@tcp:35:rm.0 Request processed in 323us (1034us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1784938135.925179:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784938135.934320:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938135.935802:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048693504 00000100:00100000:0.0:1784938135.935820:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048693504 00000100:00100000:0.0:1784938135.935976:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:0.0:1784938135.935990:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:9656:x1871643048693504:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:0.0:1784938135.936024:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938135.936050:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec38b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897871 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.936274:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec38c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.936289:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec38c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.936315:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec38c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938135.936328:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1784938135.936534:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030200/0xea86628a8aec38b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897871 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.936556:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec38c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897871 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.936565:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938135.936568:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938135.936572:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031600, rc 0) 00000100:00100000:0.0:1784938135.936667:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048693504:12345-192.168.201.58@tcp:101:rm.0 Request processed in 681us (2360us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784938135.936674:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1784938135.942811:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938135.943808:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048693632 00000100:00100000:2.0:1784938135.943823:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048693632 00000100:00100000:0.0:1784938135.944101:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784938135.944114:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048693632:12345-192.168.201.58@tcp:41:rm.0 00000004:00000024:0.0:1784938135.944205:0:5805:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1784938135.944318:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048693632:12345-192.168.201.58@tcp:41:rm.0 Request processed in 207us (1518us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938135.944326:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:3.0:1784938135.947128:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.947285:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048693760 00000100:00100000:1.0:1784938135.947296:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048693760 00000100:00100000:1.0:1784938135.947347:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:1.0:1784938135.947357:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048693760:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:1.0:1784938135.947379:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938135.947402:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec38ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897878 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947474:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947491:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947503:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947520:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947538:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947545:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947739:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947754:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947762:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938135.947793:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1784938135.947798:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938135.947817:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947829:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947837:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947844:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947850:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.947856:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991c00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.948063:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948073:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948087:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938135.948090:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.948103:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948109:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec38d5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948135:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948142:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948147:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948153:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.948156:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948162:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948169:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbf4b6a20 (ffffa05ac7d1d000) 00010000:00010000:1.0:1784938135.948171:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.948174:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948179:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec38dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948591:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec38ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897878 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948680:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897878 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.948688:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac3861e00) 00010000:00010000:1.0:1784938135.948691:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938135.948694:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991200, rc 0) 00000100:00100000:1.0:1784938135.948762:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:9656:x1871643048693760:12345-192.168.201.58@tcp:101:rm.0 Request processed in 1405us (1643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938135.948770:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:3.0:1784938135.953310:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.953437:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048694016 00000100:00100000:1.0:1784938135.953449:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048694016 00000100:00100000:1.0:1784938135.953533:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:1.0:1784938135.953544:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:9656:x1871643048694016:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:1.0:1784938135.953616:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784938135.953646:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec38e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897878 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953683:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec388f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89785c expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953695:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac3861e00) 00010000:00010000:1.0:1784938135.953713:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec38a4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897863 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953724:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938135.953742:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938135.953767:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953780:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953791:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953806:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953814:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953820:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953953:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953962:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.953969:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938135.954823:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1784938135.954838:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 344897621325ns, next at 345897618553ns, rc = 0 00010000:00010000:1.0:1784938135.954914:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.954935:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.954945:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.954953:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.954960:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.954967:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.954992:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938135.955014:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955020:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955026:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955032:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.955037:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955045:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955070:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac7d1df00) 00010000:00010000:1.0:1784938135.955073:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938135.955079:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955085:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec38f8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955114:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955121:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955127:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955132:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.955135:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955141:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955149:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938135.955151:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.955154:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.955159:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec38ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938135.955182:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdaea838 reply state 00000000a3474b6e transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938135.955192:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938135.955314:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048694016:12345-192.168.201.58@tcp:36:rm.0 Request processed in 1768us (2011us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784938135.955323:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00010000:00010000:0.0:1784938135.955834:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938135.955843:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.955850:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938135.955861:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.955868:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.955878:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffffa05ac7d1df00) 00010000:00010000:0.0:1784938135.955881:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784938135.955884:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.955890:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec38ff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938135.955910:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938135.955912:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938135.955914:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938135.958258:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.958275:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.958283:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.958289:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.958293:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.958301:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.958319:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xbf4b6a20 (ffffa05ac7d1da00) 00010000:00010000:1.0:1784938135.958321:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.958326:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.958333:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec38f1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xbf4b6a20 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938135.971795:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.971882:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048694272 00000100:00100000:1.0:1784938135.971895:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048694272 00000100:00100000:1.0:1784938135.971961:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784938135.971970:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:9656:x1871643048694272:12345-192.168.201.58@tcp:35:rm.0 00000100:00100000:1.0:1784938135.972314:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048694272:12345-192.168.201.58@tcp:35:rm.0 Request processed in 344us (531us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784938135.972322:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1784938135.975114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938135.975244:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048694528 00000100:00100000:1.0:1784938135.975254:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048694528 00000100:00100000:1.0:1784938135.975300:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1784938135.975310:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:9656:x1871643048694528:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:1.0:1784938135.975365:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784938135.975390:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec38c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897871 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975411:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec385e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89784e expref: 15 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975428:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938135.975442:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec381f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897840 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975461:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:1.0:1784938135.975467:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938135.975490:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975517:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975539:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975553:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975560:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975566:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975903:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975912:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.975919:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938135.976544:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1784938135.976561:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976569:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976576:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976588:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.976593:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976600:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976610:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffffa05ac7d1d200) 00010000:00010000:1.0:1784938135.976612:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1784938135.976617:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976623:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3914 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976648:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976654:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976660:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976665:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.976668:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976673:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976687:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac7d1da00) 00010000:00010000:1.0:1784938135.976689:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.976692:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.976698:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3906 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938135.976710:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cdf8ce58 reply state 000000005e242f78 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938135.976719:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938135.976810:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:9656:x1871643048694528:12345-192.168.201.58@tcp:36:rm.0 Request processed in 1499us (1702us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1784938135.976818:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00010000:00010000:1.0:1784938135.982393:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.982418:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.982427:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.982433:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938135.982439:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.982450:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.982501:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffffa05ac7d1d000) 00010000:00010000:1.0:1784938135.982504:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938135.982510:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938135.982517:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec390d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938136.114253:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065505024:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938136.114796:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938136.115097:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505024 00000100:00100000:2.0:1784938136.115107:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505024 00000100:00100000:2.0:1784938136.115183:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 48 00000100:00100000:2.0:1784938136.115204:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065505024:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938136.115287:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938136.115351:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065505024:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 149us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938136.115359:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 48 00010000:00080000:3.0:1784938136.115919:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05afbeb2300 x1871643065505024/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938136.115942:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065505024:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:0.0:1784938136.116501:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938136.433621:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938137.458488:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938138.161689:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065505152:0@lo:400:kworker.0 00000100:00100000:3.0:1784938138.161729:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065505536:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938138.161904:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065505280:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938138.162723:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065505408:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938138.169086:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938138.169168:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065505664:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938138.169308:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505152 00000100:00100000:1.0:1784938138.169317:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505152 00000100:00100000:1.0:1784938138.169370:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784938138.169379:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065505152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938138.169464:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065505152:12345-0@lo:400:kworker.0 Request processed in 85us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938138.169473:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1784938138.169551:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938138.169711:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938138.169940:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505536 00000100:00100000:1.0:1784938138.169945:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505536 00000100:00100000:1.0:1784938138.169991:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 56 00000100:00100000:1.0:1784938138.169999:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065505536:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938138.170036:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065505536:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 38us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938138.170058:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 56 00000100:00100000:1.0:1784938138.170079:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505664 00000100:00100000:1.0:1784938138.170083:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505664 00000100:00100000:1.0:1784938138.170112:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 103 00000100:00100000:1.0:1784938138.170120:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065505664:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938138.170153:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065505664:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 36us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938138.170159:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 103 00000100:00080000:1.0:1784938138.170174:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938138.170179:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938138.170338:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065505152:0@lo:400:kworker.0 00000100:00100000:1.0:1784938138.170355:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065505664:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938138.175543:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065505792:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938138.178793:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938138.178854:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938138.178896:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505792 00000100:00100000:2.0:1784938138.178904:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505792 00000100:00100000:2.0:1784938138.178979:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 57 00000100:00100000:2.0:1784938138.179004:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065505792:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938138.179087:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065505792:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 87us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938138.179095:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 57 00000100:00080000:2.0:1784938138.179124:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938138.179730:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505280 00000100:00100000:3.0:1784938138.179747:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505280 00000100:00100000:3.0:1784938138.179832:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 104 00000100:00100000:3.0:1784938138.179843:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065505280:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938138.179941:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065505280:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 100us (1160us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938138.179952:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 104 00000100:00100000:3.0:1784938138.182159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938138.182292:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065505280:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938138.182959:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505408 00000100:00100000:0.0:1784938138.182974:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505408 00000100:00100000:0.0:1784938138.183063:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 105 00000100:00100000:0.0:1784938138.183073:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065505408:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938138.183155:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065505408:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 83us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938138.183162:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 105 00000100:00080000:0.0:1784938138.185319:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1784938138.185423:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822b100 x1871643065505792/t0(0) o400->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938138.185442:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065505792:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938138.185529:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac8228000 x1871643065505536/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938154 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938138.185822:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065505536:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938138.186306:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065505408:192.168.201.158@tcp:400:kworker.0 00010000:00010000:1.0:1784938138.481790:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938138.548921:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938138.548950:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938138.548988:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938138.549017:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938138.549148:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048694784 00000100:00100000:2.0:1784938138.549158:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048694784 00000100:00100000:3.0:1784938138.549210:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695040 00000100:00100000:3.0:1784938138.549242:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695040 00000100:00100000:1.0:1784938138.551849:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048694912 00000100:00100000:1.0:1784938138.551867:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048694912 00000100:00100000:2.0:1784938138.553287:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:2.0:1784938138.553305:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2357:x1871643048694784:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938138.553431:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2357:x1871643048694784:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 132us (4522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938138.553440:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:3.0:1784938138.555315:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:3.0:1784938138.555329:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048695040:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938138.555414:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048695040:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 88us (6463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938138.555423:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:2.0:1784938138.558697:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048694656 00000100:00100000:2.0:1784938138.558713:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048694656 00000100:00100000:2.0:1784938138.558778:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 249 00000100:00100000:2.0:1784938138.558788:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048694656:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938138.558868:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048694656:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 80us (9878us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938138.558876:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 249 00000100:00100000:1.0:1784938138.559383:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:1.0:1784938138.559548:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048694912:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938138.559649:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048694912:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 105us (10629us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938138.559656:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00080000:0.0:1784938138.561223:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938138.561464:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938138.674492:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065505920:192.168.201.158@tcp:13:osp-pre-1-0.0 00000004:00080000:2.0:1784938138.674637:0:7842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 347617420165ns, next at 348617167310ns, rc = 0 00000100:00100000:2.0:1784938138.674817:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938138.674843:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065505920 00000100:00100000:2.0:1784938138.674851:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065505920 00000100:00100000:2.0:1784938138.674896:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 49 00000100:00100000:2.0:1784938138.674905:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065505920:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938138.674943:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938138.674994:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065505920:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 89us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938138.675001:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 49 00010000:00080000:3.0:1784938138.675177:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af52baa00 x1871643065505920/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938154 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938138.675194:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065505920:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938139.505562:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938140.529461:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938140.760500:0:11485:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1784938140.763163:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967305 is committed 00000001:00080000:2.0:1784938140.763189:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1784938140.763200:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000004:00080000:2.0:1784938140.763245:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000100:00100000:1.0:1784938140.763400:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065506048:192.168.201.158@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938140.764470:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938140.764553:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065506048 00000100:00100000:1.0:1784938140.764561:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065506048 00000100:00100000:1.0:1784938140.764679:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00100000:1.0:1784938140.764690:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065506048:12345-192.168.201.158@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938140.764723:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1784938140.764763:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a63fe98, atime: 0x6a63fe98, ctime: 0x6a63fe98, blocks: 0x1 00010000:00010000:1.0:1784938140.764772:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.764790:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:1.0:1784938140.764795:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938140.764801:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.764821:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.764831:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.764840:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.764858:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938140.765494:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3323:x1871643065506048:12345-192.168.201.158@tcp:6:osp-syn-1-0.0 Request processed in 804us (1024us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1784938140.765504:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 18 00010000:00010000:1.0:1784938140.765530:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938140.765538:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.765552:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938140.765557:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.765568:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.765586:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.765593:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec391b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938140.765606:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938140.765608:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938140.765609:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1784938140.766291:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05afbeafb80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1784938140.766302:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065506048:192.168.201.158@tcp:6:osp-syn-1-0.0 00000100:00080000:2.0:1784938140.766360:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938141.233935:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065506176:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938141.234191:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938141.234241:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065506176 00000100:00100000:0.0:1784938141.234249:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065506176 00000100:00100000:0.0:1784938141.234304:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 50 00000100:00100000:0.0:1784938141.234313:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065506176:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938141.234347:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938141.234390:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065506176:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 77us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938141.234398:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 50 00010000:00080000:0.0:1784938141.235575:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824000 x1871643065506176/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938141.235601:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065506176:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:3.0:1784938141.240990:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1784938141.322918:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:1.0:1784938141.555278:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1784938141.949881:0:11534:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff895560a0 20000000:00000080:0.0:1784938141.949898:0:11534:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa05aff9d6000 uarg=0000000000000000 20000000:01000000:0.0:1784938141.949941:0:11534:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784938141.949955:0:11534:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1784938141.949961:0:11534:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1784938141.950961:0:11535:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1784938141.951452:0:11534:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1784938141.957435:0:11534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1784938141.957496:0:11534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1784938141.957561:0:11534:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1784938141.957578:0:11534:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784938141.957598:0:11534:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957617:0:11534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec37bd expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957625:0:11534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec37cb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957633:0:11534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957643:0:11534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957650:0:11534:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957658:0:11534:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957695:0:11534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957724:0:11534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 12 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938141.957739:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506304:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938141.957889:0:11534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957898:0:11534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938141.957907:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506432:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938141.957934:0:11534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.957943:0:11534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 18 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938141.957952:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2827480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506560:0@lo:104: 00000100:00100000:0.0:1784938141.957988:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938141.958027:0:11534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec37cb expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.958034:0:11534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec37cb expref: 18 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938141.958042:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506688:0@lo:104: 00000100:00100000:0.0:1784938141.958058:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938141.958106:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065506560 00000100:00100000:0.0:1784938141.958113:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065506560 00000100:00100000:0.0:1784938141.958147:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065506688 00000100:00100000:0.0:1784938141.958149:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065506688 00000100:00100000:0.0:1784938141.958162:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938141.958171:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:11534:x1871643065506560:12345-0@lo:104: 00010000:00010000:0.0:1784938141.958185:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.958274:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938141.958280:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+4:11534:x1871643065506560:12345-0@lo:104: Request processed in 111us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938141.958287:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938141.958305:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1784938141.958311:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:11534:x1871643065506688:12345-0@lo:104: 00010000:00010000:0.0:1784938141.958319:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.958353:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1784938141.958359:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:11534:x1871643065506688:12345-0@lo:104: Request processed in 49us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938141.958364:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1784938141.958402:0:11534:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec37bd expref: 18 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.958410:0:11534:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec37bd expref: 18 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938141.958430:0:11534:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506816:0@lo:104: 00000100:00100000:0.0:1784938141.958462:0:11534:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938141.958487:0:5788:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1784938141.958497:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065506816 00000100:00100000:0.0:1784938141.958500:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065506816 00000100:00100000:0.0:1784938141.958518:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938141.958523:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:11534:x1871643065506816:12345-0@lo:104: 00010000:00010000:0.0:1784938141.958530:0:5788:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.958568:0:5788:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1784938141.958573:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+3:11534:x1871643065506816:12345-0@lo:104: Request processed in 50us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938141.958579:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938141.958619:0:11534:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711b40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938141.958643:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2827480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506560:0@lo:104: 00000100:00100000:0.0:1784938141.958651:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506688:0@lo:104: 00000100:00100000:0.0:1784938141.958656:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506816:0@lo:104: 00010000:00010000:1.0:1784938141.959389:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1784938141.959402:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959411:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938141.959415:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959445:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938141.959452:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938141.959458:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938141.959509:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959515:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938141.959539:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959547:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87c000/0xea86628a8aec37d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37e0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959562:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938141.959565:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959570:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938141.959573:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959579:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938141.959585:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938141.959595:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938141.959610:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959615:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938141.959621:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959627:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec37cb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37d2 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959635:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938141.959638:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959644:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938141.959646:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959652:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938141.959657:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938141.959661:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1784938141.959674:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959680:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938141.959702:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959710:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87da00/0xea86628a8aec37bd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec37c4 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.959723:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938141.959725:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938141.959726:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938141.959733:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938141.959748:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065507072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938141.959806:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938141.959833:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938141.959838:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065506944:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938141.959860:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938141.959885:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065507200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938141.959908:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938141.959939:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507072 00000100:00100000:1.0:1784938141.959945:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507072 00010000:00010000:1.0:1784938141.959969:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec37cb expref: 19 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938141.959994:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065506944 00000100:00100000:1.0:1784938141.959997:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065506944 00010000:00010000:1.0:1784938141.960007:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 20 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938141.960017:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507200 00000100:00100000:1.0:1784938141.960020:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507200 00010000:00010000:1.0:1784938141.960028:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec37bd expref: 21 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938141.960050:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784938141.960057:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+21:3322:x1871643065507072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938141.960070:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938141.960076:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec37cb expref: 21 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960085:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec37cb expref: 21 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960765:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892000/0xea86628a8aec37d2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec37cb expref: 21 pid: 5797 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960784:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938141.960829:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:3322:x1871643065507072:12345-0@lo:103:ldlm_bl.0 Request processed in 772us (1022us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938141.960837:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784938141.960857:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784938141.960863:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065506944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938141.960871:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938141.960875:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 19 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960884:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 19 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960895:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892800/0xea86628a8aec37e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec37d9 expref: 19 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960915:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938141.960938:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:3322:x1871643065506944:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938141.960945:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784938141.960958:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784938141.960964:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:3323:x1871643065507200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938141.960972:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938141.960976:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec37bd expref: 17 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960984:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec37bd expref: 17 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.960993:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0031200/0xea86628a8aec37c4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec37bd expref: 17 pid: 5799 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.961002:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938141.961032:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065507200:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938141.961038:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784938141.961477:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065506944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938141.961489:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065507072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938141.962084:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065507200:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938141.968299:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938141.968439:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506304:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938141.968455:0:11534:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11534:1871643065506432:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938141.968512:0:11534:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938141.968612:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695168 00000100:00100000:1.0:1784938141.968621:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695168 00010000:00010000:1.0:1784938141.968667:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 13 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938141.968709:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784938141.968734:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048695168:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938141.968754:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938141.968760:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 13 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.968772:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 13 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.968791:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05aff87c200/0xea86628a8aec37ee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897832 expref: 13 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938141.968808:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938141.968857:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:2356:x1871643048695168:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 124us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938141.968865:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784938141.976389:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938141.976600:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695296 00000100:00100000:3.0:1784938141.976610:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695296 00010000:00010000:3.0:1784938141.976656:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938141.976700:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784938141.976710:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:2356:x1871643048695296:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938141.976728:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938141.976735:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976750:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976768:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893000/0xea86628a8aec37e7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89782b expref: 12 pid: 5797 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976786:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976796:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976815:0:5792:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976837:0:5792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976844:0:5792:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976851:0:5792:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976858:0:5792:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938141.976862:0:5792:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.976871:0:5792:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.982464:0:11534:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938141.982484:0:11534:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.984730:0:5792:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.984748:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0031800/0xea86628a8aec3922 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11534 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938141.984774:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938141.985812:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2356:x1871643048695296:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 9094us (9425us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938141.985825:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00010000:00010000:1.0:1784938142.580360:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938143.281559:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065507584:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938143.281699:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784938143.281707:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065507456:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938143.281753:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065507968:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938143.282002:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938143.282054:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938143.282205:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065507712:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.282267:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938143.282275:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065507328:0@lo:400:kworker.0 00000100:00100000:0.0:1784938143.282308:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.282349:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065507840:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.282499:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507456 00000100:00100000:0.0:1784938143.282515:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507456 00000100:00100000:0.0:1784938143.282574:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507584 00000100:00100000:0.0:1784938143.282578:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507584 00000100:00100000:0.0:1784938143.282630:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 108 00000100:00100000:0.0:1784938143.282640:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065507456:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.282708:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065507456:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 62us (699us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.282716:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 108 00000100:00100000:0.0:1784938143.282742:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 109 00000100:00100000:0.0:1784938143.282749:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065507584:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.282780:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065507584:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.282786:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 109 00000100:00100000:0.0:1784938143.282811:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507328 00000100:00100000:0.0:1784938143.282814:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507328 00000100:00100000:0.0:1784938143.282845:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1784938143.282887:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065507328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938143.282942:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065507328:12345-0@lo:400:kworker.0 Request processed in 90us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.282948:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:0.0:1784938143.282975:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938143.283008:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065507328:0@lo:400:kworker.0 00000100:00100000:3.0:1784938143.283541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938143.283664:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065507456:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938143.283686:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065507584:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938143.284093:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938143.284141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938143.284165:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507840 00000100:00100000:2.0:1784938143.284171:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507840 00000100:00100000:2.0:1784938143.284243:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 110 00000100:00100000:2.0:1784938143.284252:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065507840:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938143.284303:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065507840:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 53us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.284311:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 110 00000100:00080000:2.0:1784938143.284331:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938143.284462:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065507840:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.284899:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507968 00000100:00100000:0.0:1784938143.284905:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507968 00000100:00100000:0.0:1784938143.284950:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065507712 00000100:00100000:0.0:1784938143.284953:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065507712 00000100:00100000:0.0:1784938143.284980:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 59 00000100:00100000:0.0:1784938143.284989:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065507968:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.285027:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065507968:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 39us (2949us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.285034:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 59 00000100:00100000:0.0:1784938143.285047:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 60 00000100:00100000:0.0:1784938143.285054:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065507712:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938143.285647:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065507712:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (999us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.285656:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 60 00000100:00100000:3.0:1784938143.285823:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1784938143.285831:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05afbeafb80, transno 4294967300 00000100:00100000:3.0:1784938143.285844:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065507968:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938143.286647:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af5259180 x1871643065507712/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938159 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938143.286661:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065507712:192.168.201.158@tcp:400:kworker.0 00000100:00080000:2.0:1784938143.287198:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938143.287204:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 10000000:01000000:3.0:1784938143.473663:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938143.473672:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac7f16000 from 7 10000000:01000000:3.0:1784938143.473677:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938143.473725:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.473737:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.473749:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.473777:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.473863:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.473934:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1708600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938143.474119:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508096 00000100:00100000:1.0:1784938143.474127:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508096 00000100:00100000:1.0:1784938143.474176:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:1.0:1784938143.474186:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:5802:x1871643065508096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938143.474202:0:5799:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938143.474237:0:5799:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991200/0xea86628a8aec3930 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3929 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.474260:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991200/0xea86628a8aec3930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3929 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.474270:0:5799:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991200/0xea86628a8aec3930 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3929 expref: 17 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.474296:0:5799:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991200, rc 0) 00000100:00100000:1.0:1784938143.474350:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065508096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 165us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.474367:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1784938143.474762:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938143.474790:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.474874:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.474948:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.474980:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.475069:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1708600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938143.487538:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508224 00000100:00100000:2.0:1784938143.487556:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508224 00000100:00100000:2.0:1784938143.487635:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1784938143.488487:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065508224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938143.489350:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae165ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065508224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 879us (14364us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.489372:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1784938143.503667:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.503746:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.504068:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.504122:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1708600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.504239:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508352 00000100:00100000:0.0:1784938143.504246:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508352 00000100:00100000:0.0:1784938143.504301:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1784938143.504320:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065508352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.504945:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8451c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065508352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 625us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.504955:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1784938143.506124:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938143.506886:0:11548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11548:1871643065508480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938143.506963:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938143.507003:0:11548:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bca80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938143.507111:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508480 00000100:00100000:2.0:1784938143.507117:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508480 00000100:00100000:2.0:1784938143.507162:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1784938143.507170:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:11548:x1871643065508480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938143.507449:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8453450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:11548:x1871643065508480:12345-0@lo:502:llog_process_th.0 Request processed in 278us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.507467:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1784938143.508923:0:11548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11548:1871643065508480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938143.508971:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938143.508983:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.508985:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784938143.508992:0:11548:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa05ac7f16000 00000020:00000080:1.0:1784938143.508994:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938143.509094:0:11548:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11548:1871643065508608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938143.509162:0:11548:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938143.509200:0:11548:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.509813:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508608 00000100:00100000:0.0:1784938143.509823:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508608 00000100:00100000:0.0:1784938143.509888:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1784938143.509899:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:11548:x1871643065508608:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938143.510149:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6a7d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:11548:x1871643065508608:12345-0@lo:502:llog_process_th.0 Request processed in 252us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.510157:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1784938143.511654:0:11548:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11548:1871643065508608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938143.511705:0:11548:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938143.511716:0:11548:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.511718:0:11548:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784938143.511723:0:11548:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1784938143.512655:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1784938143.512685:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1784938143.512698:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.512710:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938143.512721:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938143.512724:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac73fb000 from 7 10000000:01000000:3.0:1784938143.512727:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938143.512766:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.512790:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938143.512811:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938143.512835:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.512904:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.512940:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1708600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.514018:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508736 00000100:00100000:0.0:1784938143.514033:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508736 00000100:00100000:0.0:1784938143.514101:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1784938143.514111:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:5802:x1871643065508736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938143.514128:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938143.514145:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030400/0xea86628a8aec393e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3937 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.514170:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030400/0xea86628a8aec393e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3937 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.514182:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030400/0xea86628a8aec393e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3937 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.514191:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030400, rc 0) 00000100:00100000:0.0:1784938143.514276:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065508736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (1371us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.514291:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1784938143.514507:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938143.514524:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.514545:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938143.514616:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938143.514938:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938143.514984:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bca80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.516381:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508864 00000100:00100000:0.0:1784938143.516401:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508864 00000100:00100000:0.0:1784938143.516756:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1784938143.516771:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065508864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.517327:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065508864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 558us (2387us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.517336:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1784938143.519431:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.519503:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1784938143.519577:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938143.519624:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae17083c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.521404:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065508992 00000100:00100000:0.0:1784938143.521418:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065508992 00000100:00100000:0.0:1784938143.521493:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784938143.521503:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065508992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.521791:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8669450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065508992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 289us (2214us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.521811:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1784938143.521884:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065508992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.522115:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11550:1871643065509120:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938143.522161:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.522192:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.522238:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509120 00000100:00100000:0.0:1784938143.522242:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509120 00000100:00100000:0.0:1784938143.522267:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784938143.522274:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:11550:x1871643065509120:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938143.522426:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac866a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:11550:x1871643065509120:12345-0@lo:502:llog_process_th.0 Request processed in 152us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.522442:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1784938143.522482:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11550:1871643065509120:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938143.522504:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938143.522515:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938143.522518:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938143.522526:0:11550:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa05ac73fb000 00000020:00000080:0.0:1784938143.522528:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1784938143.522595:0:11550:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11550:1871643065509248:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938143.522628:0:11550:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.522645:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509248 00000100:00100000:0.0:1784938143.522649:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509248 00000100:00100000:0.0:1784938143.522668:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784938143.522674:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:11550:x1871643065509248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938143.522774:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8668850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:11550:x1871643065509248:12345-0@lo:502:llog_process_th.0 Request processed in 99us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.522781:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1784938143.522808:0:11550:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae1711e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.522821:0:11550:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11550:1871643065509248:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938143.522838:0:11550:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938143.522843:0:11550:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938143.522844:0:11550:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784938143.522848:0:11550:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1784938143.522897:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1784938143.522915:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938143.522925:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.522946:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938143.522958:0:5802:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938143.522960:0:5802:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05ac735f800 from 7 10000000:01000000:0.0:1784938143.522963:0:5802:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938143.522988:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.522996:0:5802:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.523004:0:5802:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.523017:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065509376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.523043:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.523057:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.523070:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509376 00000100:00100000:0.0:1784938143.523073:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509376 00000100:00100000:0.0:1784938143.523093:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784938143.523100:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:5802:x1871643065509376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938143.523109:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938143.523120:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030800/0xea86628a8aec394c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec3945 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.523141:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030800/0xea86628a8aec394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec3945 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.523163:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030800/0xea86628a8aec394c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec3945 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.523173:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030800, rc 0) 00000100:00100000:0.0:1784938143.523204:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065509376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.523210:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1784938143.523261:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065509376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938143.523274:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.523282:0:5802:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938143.523317:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065509504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.523349:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.523365:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.523377:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509504 00000100:00100000:0.0:1784938143.523380:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509504 00000100:00100000:0.0:1784938143.523414:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784938143.523420:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065509504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.523652:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065509504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 231us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.523659:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1784938143.523689:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065509504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.523723:0:5802:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065509632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.523756:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.523768:0:5802:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938143.523779:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509632 00000100:00100000:0.0:1784938143.523781:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509632 00000100:00100000:0.0:1784938143.523796:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784938143.523801:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065509632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.523903:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:5802:x1871643065509632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.523910:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1784938143.523950:0:5802:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:5802:1871643065509632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.524175:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11551:1871643065509760:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938143.524207:0:11551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938143.524249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509760 00000100:00100000:0.0:1784938143.524252:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509760 00000100:00100000:0.0:1784938143.524274:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1784938143.524280:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:11551:x1871643065509760:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938143.529377:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938143.529449:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11551:1871643065509760:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938143.529525:0:11551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1784938143.529540:0:11551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.529543:0:11551:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1784938143.529550:0:11551:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa05ac735f800 00000020:00000080:1.0:1784938143.529554:0:11551:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1784938143.529688:0:11551:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11551:1871643065509888:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938143.529778:0:11551:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938143.530245:0:11551:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31bc600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938143.530380:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065509888 00000100:00100000:2.0:1784938143.530390:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065509888 00000100:00100000:2.0:1784938143.530477:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1784938143.530488:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:11551:x1871643065509888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938143.531072:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+20:11551:x1871643065509888:12345-0@lo:502:llog_process_th.0 Request processed in 583us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.531081:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1784938143.532158:0:11551:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:11551:1871643065509888:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1784938143.532208:0:11551:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938143.532247:0:11551:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938143.532250:0:11551:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1784938143.532255:0:11551:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:0.0:1784938143.532696:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:11551:x1871643065509760:12345-0@lo:502:llog_process_th.0 Request processed in 114us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.532707:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000020:01000000:2.0:1784938143.533402:0:5802:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1784938143.533437:0:5802:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938143.534046:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938143.534082:0:5802:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938143.550430:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938143.603844:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938143.673824:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938143.673866:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938143.673907:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938143.673978:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695424 00000100:00100000:2.0:1784938143.674001:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695424 00000100:00100000:2.0:1784938143.674059:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 266 00000100:00100000:2.0:1784938143.674070:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2358:x1871643048695424:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938143.674586:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695680 00000100:00100000:1.0:1784938143.674592:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695680 00000100:00100000:2.0:1784938143.683545:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2358:x1871643048695424:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 9459us (9716us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.683561:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 266 00000100:00100000:3.0:1784938143.684059:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938143.684096:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695552 00000100:00100000:3.0:1784938143.684106:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695552 00000100:00100000:3.0:1784938143.684156:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695808 00000100:00100000:3.0:1784938143.684160:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695808 00000100:00100000:3.0:1784938143.684185:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:3.0:1784938143.684194:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048695552:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938143.684281:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048695552:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 88us (10373us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.684289:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:3.0:1784938143.684317:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:3.0:1784938143.684323:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048695808:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938143.684347:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048695808:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.684353:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00080000:0.0:1784938143.684496:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938143.684502:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938143.700764:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:1.0:1784938143.700809:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048695680:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938143.700952:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048695680:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 172us (27084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.700960:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:3.0:1784938143.734106:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938143.734247:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048695936 00000100:00100000:0.0:1784938143.734259:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048695936 00000100:00100000:0.0:1784938143.734318:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 267 00000100:00100000:0.0:1784938143.734329:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:5573:x1871643048695936:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938143.734379:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938143.734412:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3953 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89787f expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.734458:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89787f expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.734471:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3953 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89787f expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938143.734482:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030200, rc 0) 00000100:00100000:0.0:1784938143.734545:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048695936:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 218us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.734553:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 267 00000100:00100000:3.0:1784938143.738843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938143.738937:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696064 00000100:00100000:1.0:1784938143.738947:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696064 00000100:00100000:1.0:1784938143.739019:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 268 00000100:00100000:1.0:1784938143.739030:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048696064:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938143.739434:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048696064:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 404us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.739443:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 268 00000100:00100000:3.0:1784938143.751045:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938143.751265:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696192 00000100:00100000:2.0:1784938143.751275:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696192 00000100:00100000:2.0:1784938143.751333:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 269 00000100:00100000:2.0:1784938143.751343:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048696192:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938143.751860:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048696192:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 518us (825us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938143.751868:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 269 00000100:00100000:2.0:1784938143.766096:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938143.766628:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696320 00000100:00100000:0.0:1784938143.766640:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696320 00000100:00100000:0.0:1784938143.766702:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 270 00000100:00100000:0.0:1784938143.766712:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:9927:x1871643048696320:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938143.766988:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:9927:x1871643048696320:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 277us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.766996:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 270 00000100:00100000:3.0:1784938143.776320:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938143.776432:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696448 00000100:00100000:1.0:1784938143.776444:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696448 00000100:00100000:1.0:1784938143.776511:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 271 00000100:00100000:1.0:1784938143.776522:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:9927:x1871643048696448:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938143.776828:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+12:9927:x1871643048696448:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 306us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.776836:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 271 00000100:00100000:0.0:1784938143.793914:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938143.794094:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696576 00000100:00100000:1.0:1784938143.794105:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696576 00000100:00100000:1.0:1784938143.794161:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 272 00000100:00100000:1.0:1784938143.794171:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:5573:x1871643048696576:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938143.794190:0:5798:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938143.794211:0:5798:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990600/0xea86628a8aec395a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897886 expref: -99 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.794304:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990600/0xea86628a8aec395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897886 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.794317:0:5798:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990600/0xea86628a8aec395a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897886 expref: 13 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938143.794329:0:5798:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990600, rc 0) 00000100:00100000:1.0:1784938143.794402:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048696576:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 232us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.794410:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 272 00000100:00100000:3.0:1784938143.795972:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065510016:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938143.796789:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938143.808322:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938143.808448:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696704 00000100:00100000:0.0:1784938143.808459:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696704 00000100:00100000:0.0:1784938143.808525:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 273 00000100:00100000:0.0:1784938143.808536:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048696704:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.809154:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048696704:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 616us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.809164:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 273 00000100:00100000:1.0:1784938143.810253:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510016 00000100:00100000:1.0:1784938143.810264:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510016 00000100:00100000:1.0:1784938143.810324:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 51 00000100:00100000:1.0:1784938143.810333:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065510016:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938143.810373:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938143.819024:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065510016:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 8678us (22225us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938143.819041:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 51 00000100:00100000:1.0:1784938143.827850:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065510016:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938143.832726:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938143.846940:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696832 00000100:00100000:1.0:1784938143.846955:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696832 00000100:00100000:0.0:1784938143.847154:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 274 00000100:00100000:0.0:1784938143.847164:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048696832:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938143.847461:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:5573:x1871643048696832:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 297us (14745us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.847470:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 274 00000100:00100000:3.0:1784938143.870783:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938143.873286:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048696960 00000100:00100000:0.0:1784938143.873304:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048696960 00000100:00100000:0.0:1784938143.873395:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 275 00000100:00100000:0.0:1784938143.873405:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:9930:x1871643048696960:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938143.873718:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:9930:x1871643048696960:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 313us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938143.873727:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 275 00000100:00100000:1.0:1784938143.883394:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938143.883496:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697088 00000100:00100000:3.0:1784938143.883506:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697088 00000100:00100000:3.0:1784938143.883572:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 276 00000100:00100000:3.0:1784938143.883585:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:9930:x1871643048697088:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938143.884081:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac6bdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:9930:x1871643048697088:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 496us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938143.884090:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 276 00000040:00080000:2.0:1784938144.561944:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938144.625558:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938145.658981:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938146.353646:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938146.353676:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065510144:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938146.354184:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938146.354265:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510144 00000100:00100000:3.0:1784938146.354273:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510144 00000100:00100000:3.0:1784938146.354327:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 52 00000100:00100000:3.0:1784938146.354337:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065510144:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938146.354406:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938146.354560:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065510144:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 223us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938146.354567:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 52 00010000:00080000:1.0:1784938146.354777:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824000 x1871643065510144/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938146.354796:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065510144:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:0.0:1784938146.354955:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784938146.673462:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938147.701886:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938148.401554:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065510528:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.401680:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1784938148.401688:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065510400:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.401725:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065510912:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.401952:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938148.402004:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938148.402028:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938148.402054:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510400 00000100:00100000:3.0:1784938148.402062:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510400 00000100:00100000:3.0:1784938148.402107:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510528 00000100:00100000:3.0:1784938148.402111:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510528 00000100:00100000:3.0:1784938148.402137:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 113 00000100:00100000:3.0:1784938148.402145:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065510400:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.402196:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065510400:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 51us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938148.402204:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 113 00000100:00100000:3.0:1784938148.402253:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 114 00000100:00100000:3.0:1784938148.402260:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065510528:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.402283:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065510528:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938148.402319:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 114 00000100:00100000:3.0:1784938148.402449:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065510400:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.402461:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065510528:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.402526:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510912 00000100:00100000:3.0:1784938148.402530:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510912 00000100:00100000:3.0:1784938148.402560:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 62 00000100:00100000:3.0:1784938148.402566:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065510912:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.402599:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065510912:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 33us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938148.402605:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 62 00000100:00080000:3.0:1784938148.402621:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938148.402625:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938148.402697:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065510912:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938148.402967:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065510272:0@lo:400:kworker.0 00000100:00100000:1.0:1784938148.403013:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938148.403041:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065510784:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938148.403081:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938148.403089:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065510656:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938148.403186:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938148.403206:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938148.403240:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510656 00000100:00100000:1.0:1784938148.403244:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510656 00000100:00100000:1.0:1784938148.403281:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 63 00000100:00100000:1.0:1784938148.403288:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065510656:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938148.403333:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065510656:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 45us (125us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938148.403341:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 63 00000100:00080000:1.0:1784938148.403356:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938148.403364:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510784 00000100:00100000:1.0:1784938148.403368:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510784 00000100:00100000:1.0:1784938148.403396:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 115 00000100:00100000:1.0:1784938148.403401:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065510784:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938148.403437:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065510784:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 35us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938148.403443:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 115 00000100:00080000:1.0:1784938148.403458:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784938148.403550:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fb5c00 x1871643065510656/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938148.403561:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065510656:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938148.404023:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065510272 00000100:00100000:2.0:1784938148.404030:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065510272 00000100:00100000:2.0:1784938148.404068:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:2.0:1784938148.404075:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065510272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938148.404130:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065510272:12345-0@lo:400:kworker.0 Request processed in 55us (1116us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938148.404137:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1784938148.405891:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065510272:0@lo:400:kworker.0 00000100:00100000:1.0:1784938148.405919:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065510784:192.168.201.158@tcp:400:kworker.0 00010000:00010000:1.0:1784938148.721518:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938148.794728:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938148.794776:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938148.794870:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697344 00000100:00100000:3.0:1784938148.794887:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697344 00000100:00100000:3.0:1784938148.794970:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:3.0:1784938148.794984:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048697344:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.795072:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048697344:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 92us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938148.795080:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00080000:1.0:1784938148.795351:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938148.796452:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697216 00000100:00100000:0.0:1784938148.796464:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697216 00000100:00100000:0.0:1784938148.796534:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 278 00000100:00100000:0.0:1784938148.796543:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048697216:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938148.796628:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048697216:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 87us (1911us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938148.796636:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 278 00000100:00100000:1.0:1784938148.814042:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938148.814091:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938148.814283:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697600 00000100:00100000:2.0:1784938148.814296:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697600 00000100:00100000:2.0:1784938148.814402:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:2.0:1784938148.814413:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048697600:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938148.814503:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048697600:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 92us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938148.814511:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00080000:1.0:1784938148.814636:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938148.814997:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697472 00000100:00100000:3.0:1784938148.815003:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697472 00000100:00100000:3.0:1784938148.815064:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1784938148.815073:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048697472:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938148.815128:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2358:x1871643048697472:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 57us (1098us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938148.815134:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00080000:2.0:1784938148.815978:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938148.913937:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938148.913980:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac868d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065511040:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938148.915888:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938148.916797:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511040 00000100:00100000:3.0:1784938148.916809:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511040 00000100:00100000:3.0:1784938148.916884:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:3.0:1784938148.916895:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065511040:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938148.916939:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938148.918805:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065511040:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 1901us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938148.918820:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:0.0:1784938148.920699:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac868d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065511040:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938149.747411:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938150.769596:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938151.474408:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938151.474437:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065511168:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938151.474755:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938151.474978:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511168 00000100:00100000:2.0:1784938151.474988:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511168 00000100:00100000:2.0:1784938151.475060:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 54 00000100:00100000:2.0:1784938151.475069:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065511168:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938151.475105:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938151.475151:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065511168:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938151.475158:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 54 00000100:00080000:1.0:1784938151.475797:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938151.477009:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824e00 x1871643065511168/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938151.477033:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065511168:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938151.793509:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938152.817489:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938153.522072:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065511552:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938153.522129:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065511296:0@lo:400:kworker.0 00000100:00100000:2.0:1784938153.522188:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938153.522200:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784938153.522210:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065511424:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938153.522263:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065511808:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938153.522288:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065511936:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938153.522303:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938153.522312:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c2824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065511680:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938153.522360:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511296 00000100:00100000:2.0:1784938153.522382:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511296 00000100:00100000:2.0:1784938153.522434:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1784938153.522442:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065511296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938153.522516:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065511296:12345-0@lo:400:kworker.0 Request processed in 74us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938153.522525:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1784938153.522546:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938153.522577:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065511296:0@lo:400:kworker.0 00000100:00100000:0.0:1784938153.522625:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938153.522653:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938153.522679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938153.522898:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511424 00000100:00100000:0.0:1784938153.522904:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511424 00000100:00100000:0.0:1784938153.522938:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511552 00000100:00100000:0.0:1784938153.522940:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511552 00000100:00100000:0.0:1784938153.522965:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 118 00000100:00100000:0.0:1784938153.522973:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065511424:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938153.523011:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065511424:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 38us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938153.523020:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 118 00000100:00100000:0.0:1784938153.523052:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 119 00000100:00100000:0.0:1784938153.523059:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065511552:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938153.523083:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065511552:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938153.523089:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 119 00000100:00100000:0.0:1784938153.523109:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511936 00000100:00100000:0.0:1784938153.523113:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511936 00000100:00100000:0.0:1784938153.523140:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00100000:0.0:1784938153.523147:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065511936:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938153.523173:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065511936:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938153.523179:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00080000:0.0:1784938153.523199:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938153.523204:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938153.523568:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938153.523674:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2827480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065511424:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938153.523687:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2826680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065511936:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938153.523698:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2825500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065511552:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938153.523743:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511808 00000100:00100000:1.0:1784938153.523747:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511808 00000100:00100000:1.0:1784938153.523782:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 120 00000100:00100000:1.0:1784938153.523789:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065511808:12345-192.168.201.158@tcp:400:kworker.0 00000100:00080000:0.0:1784938153.523822:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938153.524044:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065511808:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 253us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938153.524052:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 120 00000100:00100000:0.0:1784938153.524660:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065511808:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938153.525256:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065511680 00000100:00100000:3.0:1784938153.525263:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065511680 00000100:00100000:3.0:1784938153.525428:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 66 00000100:00100000:3.0:1784938153.525439:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065511680:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938153.525524:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065511680:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 88us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938153.525532:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 66 00010000:00080000:3.0:1784938153.526551:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c2824700 x1871643065511680/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938153.526569:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c2824700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065511680:192.168.201.158@tcp:400:kworker.0 00000100:00080000:0.0:1784938153.528168:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1784938153.841465:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938153.906680:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938153.906775:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697728 00000100:00100000:3.0:1784938153.906786:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697728 00000100:00100000:3.0:1784938153.906860:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 280 00000100:00100000:3.0:1784938153.906870:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048697728:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938153.906964:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048697728:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 94us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938153.906972:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 280 00000100:00100000:2.0:1784938153.908032:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938153.908074:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938153.908105:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938153.908135:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697856 00000100:00100000:2.0:1784938153.908142:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697856 00000100:00100000:2.0:1784938153.908192:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698112 00000100:00100000:2.0:1784938153.908195:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698112 00000100:00100000:2.0:1784938153.908253:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:2.0:1784938153.908262:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048697856:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938153.908337:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048697856:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 76us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938153.908344:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:2.0:1784938153.908358:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:2.0:1784938153.908365:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048698112:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938153.908388:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048698112:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938153.908411:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00080000:2.0:1784938153.908431:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938153.908736:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048697984 00000100:00100000:1.0:1784938153.908742:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048697984 00000100:00100000:1.0:1784938153.908786:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:1.0:1784938153.908794:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048697984:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938153.908833:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048697984:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (758us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938153.908839:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00080000:2.0:1784938153.908921:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938154.033581:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac868df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065512064:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938154.034057:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938154.034391:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512064 00000100:00100000:3.0:1784938154.034400:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512064 00000100:00100000:3.0:1784938154.034458:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 55 00000100:00100000:3.0:1784938154.034467:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065512064:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938154.034506:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938154.034567:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065512064:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 101us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938154.034576:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 55 00000100:00100000:0.0:1784938154.034928:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac868df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065512064:192.168.201.158@tcp:13:osp-pre-1-0.0 00000040:00080000:0.0:1784938154.801930:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938154.865492:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938155.893811:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938156.596103:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065512192:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938156.596444:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938156.596474:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512192 00000100:00100000:3.0:1784938156.596481:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512192 00000100:00100000:3.0:1784938156.596547:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 56 00000100:00100000:3.0:1784938156.596557:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065512192:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938156.597396:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938156.597460:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065512192:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 901us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938156.597470:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 56 00000100:00080000:2.0:1784938156.597767:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1784938156.597775:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fb7100 x1871643065512192/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938156.597796:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065512192:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938156.913567:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938157.944367:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938158.644285:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065512320:0@lo:400:kworker.0 00000100:00100000:1.0:1784938158.644401:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938158.644638:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065512576:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938158.644714:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1784938158.644721:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065512448:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938158.644755:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065512960:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938158.645054:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065512704:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938158.645171:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938158.645180:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065512832:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938158.645635:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938158.645700:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938158.645735:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512960 00000100:00100000:0.0:1784938158.645745:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512960 00000100:00100000:2.0:1784938158.645921:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512320 00000100:00100000:2.0:1784938158.645927:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512320 00000100:00100000:2.0:1784938158.645986:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784938158.645997:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065512320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938158.646104:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065512320:12345-0@lo:400:kworker.0 Request processed in 108us (1702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938158.646112:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1784938158.646205:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065512320:0@lo:400:kworker.0 00000100:00100000:2.0:1784938158.646323:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938158.646356:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938158.646381:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938158.646402:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512576 00000100:00100000:2.0:1784938158.646406:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512576 00000100:00100000:2.0:1784938158.646440:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512448 00000100:00100000:2.0:1784938158.646443:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512448 00000100:00100000:2.0:1784938158.646455:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512832 00000100:00100000:2.0:1784938158.646458:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512832 00000100:00100000:2.0:1784938158.646474:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 123 00000100:00100000:2.0:1784938158.646481:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065512576:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938158.646528:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065512576:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 47us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938158.646535:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 123 00000100:00100000:2.0:1784938158.646559:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 124 00000100:00100000:2.0:1784938158.646564:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065512448:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938158.646591:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065512448:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938158.646597:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 124 00000100:00100000:2.0:1784938158.646608:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 125 00000100:00100000:2.0:1784938158.646614:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065512832:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938158.646636:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065512832:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 22us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938158.646642:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 125 00000100:00100000:2.0:1784938158.646663:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065512704 00000100:00100000:2.0:1784938158.646666:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065512704 00000100:00100000:2.0:1784938158.646698:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 68 00000100:00100000:2.0:1784938158.646704:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065512704:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938158.646730:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065512704:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938158.646736:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 68 00000100:00080000:2.0:1784938158.646765:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938158.646770:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938158.646772:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938158.648288:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 69 00000100:00100000:0.0:1784938158.648306:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065512960:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938158.658061:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065512448:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938158.658096:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065512576:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938158.658459:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065512832:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938158.658481:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac822f800 x1871643065512704/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938174 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938158.658493:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065512704:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938158.660993:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065512960:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 12673us (15271us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938158.661026:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 69 00000100:00100000:3.0:1784938158.672826:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065512960:192.168.201.158@tcp:400:kworker.0 00010000:00010000:1.0:1784938158.961505:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938159.031196:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938159.031354:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698240 00000100:00100000:2.0:1784938159.031364:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698240 00000100:00100000:2.0:1784938159.031412:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 282 00000100:00100000:2.0:1784938159.031420:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048698240:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938159.031493:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048698240:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 73us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938159.031512:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 282 00000100:00100000:2.0:1784938159.060687:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938159.065207:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698496 00000100:00100000:1.0:1784938159.065259:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698496 00000100:00100000:1.0:1784938159.065473:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938159.065485:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2354:x1871643048698496:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:1.0:1784938159.065520:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3896 00000100:00080000:1.0:1784938159.065531:0:6604:0:(import.c:65:import_set_state_nolock()) ffffa05b01e00800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938159.065580:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1784938159.065916:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+2:2354:x1871643048698496:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 421us (5228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938159.065925:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938159.067320:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938159.067483:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1784938159.067548:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938159.067666:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698368 00000100:00100000:3.0:1784938159.067682:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698368 00000100:00080000:2.0:1784938159.068740:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938159.068750:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938159.068860:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698624 00000100:00100000:3.0:1784938159.068869:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698624 00000100:00100000:3.0:1784938159.068966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:3.0:1784938159.068977:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048698368:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938159.069285:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048698368:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 307us (1970us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938159.069294:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:3.0:1784938159.069318:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:3.0:1784938159.069325:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048698624:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938159.069380:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048698624:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 55us (1902us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938159.069387:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00080000:0.0:1784938159.071282:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938159.153518:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938159.156364:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac868ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065513088:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938159.164289:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938159.164383:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513088 00000100:00100000:2.0:1784938159.164394:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513088 00000100:00100000:2.0:1784938159.164505:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 57 00000100:00100000:2.0:1784938159.164516:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065513088:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938159.164570:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938159.164659:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065513088:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 145us (534us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938159.164668:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 57 00000100:00100000:0.0:1784938159.164916:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac868ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065513088:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938159.985478:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938161.009903:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938161.718412:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938161.718444:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065513216:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938161.718850:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938161.718880:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513216 00000100:00100000:0.0:1784938161.718888:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513216 00000100:00100000:0.0:1784938161.718953:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 58 00000100:00100000:0.0:1784938161.718962:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065513216:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938161.718999:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938161.719037:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065513216:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 76us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938161.719044:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 58 00000100:00080000:0.0:1784938161.719063:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1784938161.719189:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05ac83e4a80 x1871643065513216/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938161.719246:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065513216:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:00100000:3.0:1784938161.794098:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:3.0:1784938161.794109:0:7507:0:(genops.c:906:class_export_put()) final put ffffa05b01e06000/8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:2.0:1784938161.794190:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05b01e06000/8bbc0047-63c1-4cac-b5e6-ede401808e2e for lustre-OST0001 00000020:00000080:2.0:1784938161.794267:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05b01e00800 for lustre-OST0001 00010000:00010000:1.0:1784938162.033421:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938163.057670:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938163.761550:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065513472:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938163.761665:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065513984:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938163.761715:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938163.761722:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065513600:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938163.761947:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938163.762000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938163.762020:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938163.762076:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513984 00000100:00100000:1.0:1784938163.762083:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513984 00000100:00100000:1.0:1784938163.762140:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 70 00000100:00100000:1.0:1784938163.762160:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065513984:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938163.762212:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065513984:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 53us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938163.762243:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 70 00000100:00080000:1.0:1784938163.762266:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938163.762579:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065513344:0@lo:400:kworker.0 00000100:00100000:0.0:1784938163.762624:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938163.762654:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065513856:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938163.762690:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938163.762697:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065513728:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938163.762732:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513344 00000100:00100000:0.0:1784938163.762747:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513344 00000100:00100000:0.0:1784938163.762778:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784938163.762785:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065513344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938163.762827:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065513344:12345-0@lo:400:kworker.0 Request processed in 42us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938163.762833:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1784938163.762880:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065513344:0@lo:400:kworker.0 00000100:00100000:3.0:1784938163.764006:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513472 00000100:00100000:3.0:1784938163.764016:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513472 00000100:00100000:3.0:1784938163.764066:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513600 00000100:00100000:3.0:1784938163.764070:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513600 00000100:00100000:3.0:1784938163.764104:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 128 00000100:00100000:3.0:1784938163.764112:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065513472:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938163.764163:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065513472:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 52us (2162us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938163.764170:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 128 00000100:00100000:3.0:1784938163.764185:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 129 00000100:00100000:3.0:1784938163.764192:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065513600:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938163.764236:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065513600:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (2194us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938163.764253:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 129 00000100:00080000:3.0:1784938163.764296:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938163.770582:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938163.770613:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938163.770691:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513728 00000100:00100000:0.0:1784938163.770700:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513728 00000100:00100000:0.0:1784938163.770770:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 71 00000100:00100000:0.0:1784938163.770781:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065513728:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938163.770856:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065513728:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938163.770864:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 71 00000100:00100000:0.0:1784938163.770989:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065513600:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938163.771003:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065513472:192.168.201.158@tcp:400:kworker.0 00000100:00080000:3.0:1784938163.772380:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938163.772406:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065513856 00000100:00100000:3.0:1784938163.772415:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065513856 00000100:00100000:3.0:1784938163.772481:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 130 00000100:00100000:3.0:1784938163.772491:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065513856:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938163.772564:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065513856:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 75us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938163.772580:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 130 00000100:00100000:3.0:1784938163.772793:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065513856:192.168.201.158@tcp:400:kworker.0 00000100:00080000:0.0:1784938163.774190:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938163.777870:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065513984:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938163.778004:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05aee13d880 x1871643065513728/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938179 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938163.778017:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065513728:192.168.201.158@tcp:400:kworker.0 00000040:00080000:0.0:1784938164.018038:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938164.082110:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938164.154206:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938164.154269:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938164.154295:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938164.155251:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698752 00000100:00100000:2.0:1784938164.155265:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698752 00000100:00100000:2.0:1784938164.155323:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 284 00000100:00100000:2.0:1784938164.155333:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048698752:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938164.155409:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048698752:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938164.155416:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 284 00000100:00100000:2.0:1784938164.155460:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699008 00000100:00100000:2.0:1784938164.155464:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699008 00000100:00100000:2.0:1784938164.155495:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048698880 00000100:00100000:2.0:1784938164.155498:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048698880 00000100:00100000:2.0:1784938164.155519:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:2.0:1784938164.155525:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048699008:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938164.155557:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048699008:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (1289us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938164.155564:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:2.0:1784938164.155576:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:2.0:1784938164.155582:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048698880:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938164.155604:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048698880:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 22us (1309us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938164.155610:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00080000:2.0:1784938164.155755:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938164.273399:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938164.273515:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065514112:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938164.274994:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938164.275064:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514112 00000100:00100000:0.0:1784938164.275078:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514112 00000100:00100000:0.0:1784938164.275158:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 59 00000100:00100000:0.0:1784938164.275169:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065514112:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938164.275246:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938164.275310:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065514112:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 142us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938164.275318:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 59 00000100:00100000:3.0:1784938164.275468:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065514112:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938165.110435:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938166.130841:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938166.557701:0:11714:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 20:09:26 (1784938166) 00000100:00100000:3.0:1784938166.833541:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065514240:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938166.833792:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938166.833826:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514240 00000100:00100000:3.0:1784938166.833833:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514240 00000100:00080000:0.0:1784938166.833879:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938166.833900:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 60 00000100:00100000:3.0:1784938166.833919:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065514240:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938166.833958:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938166.834016:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065514240:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 100us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938166.834024:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 60 00010000:00080000:0.0:1784938166.834203:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fb7100 x1871643065514240/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938166.834255:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065514240:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938167.154357:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938168.170756:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938168.170928:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699136 00000100:00100000:3.0:1784938168.170943:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699136 00000100:00100000:3.0:1784938168.171061:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784938168.171085:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:10197:x1871643048699136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938168.171115:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938168.171147:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89788d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.171286:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec3968 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.171303:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec3968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.171339:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec3968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938168.171567:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784938168.171572:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938168.171694:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec3968 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.171723:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89788d expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.171744:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec3968 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89788d expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.171753:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861100) 00010000:00010000:3.0:1784938168.171756:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938168.171761:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c000, rc 0) 00000100:00100000:3.0:1784938168.171832:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:10197:x1871643048699136:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 752us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.171840:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00080000:2.0:1784938168.172875:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784938168.177526:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938168.185577:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938168.186102:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699264 00000100:00100000:2.0:1784938168.186117:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699264 00000100:00100000:2.0:1784938168.186198:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:2.0:1784938168.186210:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:10198:x1871643048699264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938168.186284:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938168.186316:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec396f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897894 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186430:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186447:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186460:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186478:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186486:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186493:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186988:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec3984 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.186999:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec3984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187006:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec3984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938168.187110:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1784938168.187115:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938168.187208:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec3984 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187268:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187276:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187283:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187290:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938168.187295:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187304:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187320:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861100) 00010000:00010000:2.0:1784938168.187324:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938168.187330:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187337:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3976 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187352:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187359:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187364:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187376:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938168.187379:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187386:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187396:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa05ad886ba00) 00010000:00010000:2.0:1784938168.187398:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938168.187401:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187407:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec397d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187445:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec396f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897894 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187461:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec3984 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897894 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938168.187468:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa05ad886b000) 00010000:00010000:2.0:1784938168.187471:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938168.187474:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892000, rc 0) 00000100:00100000:2.0:1784938168.187567:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:10198:x1871643048699264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1358us (2002us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.187577:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784938168.200040:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938168.200879:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699520 00000100:00100000:3.0:1784938168.200894:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699520 00000100:00100000:3.0:1784938168.200985:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784938168.200997:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:10198:x1871643048699520:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938168.201026:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938168.201063:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec398b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89789b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.201186:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.201205:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.201261:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.202856:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.202891:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.203301:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204475:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec39a0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204492:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204501:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec39a0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938168.204512:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1784938168.204813:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204822:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204837:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204843:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87de00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938168.204847:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204856:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204869:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa05ad886b000) 00010000:00010000:3.0:1784938168.204872:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938168.204876:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204893:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3992 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204916:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204923:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204928:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204934:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938168.204937:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204953:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.204962:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa05ac3861b00) 00010000:00010000:3.0:1784938168.204965:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938168.204968:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.205465:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3999 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.206081:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec398b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89789b expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.206098:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec39a0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89789b expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938168.206105:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:3.0:1784938168.206108:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938168.206111:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87dc00, rc 0) 00000100:00100000:3.0:1784938168.206190:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10198:x1871643048699520:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 5195us (6161us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784938168.206200:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:0.0:1784938168.216447:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938168.217494:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699648 00000100:00100000:2.0:1784938168.217536:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699648 00000100:00100000:2.0:1784938168.217638:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:2.0:1784938168.217653:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10198:x1871643048699648:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1784938168.217816:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10198:x1871643048699648:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 167us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.217825:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784938168.885429:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065514368:0@lo:400:kworker.0 00000100:00100000:1.0:1784938168.885533:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938168.885646:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514368 00000100:00100000:2.0:1784938168.885659:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514368 00000100:00100000:2.0:1784938168.885730:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784938168.885741:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065514368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938168.888196:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065514368:12345-0@lo:400:kworker.0 Request processed in 2442us (2649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938168.888239:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1784938168.889604:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065514496:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938168.889736:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938168.889745:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065514624:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938168.889804:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065514752:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938168.890480:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065514368:0@lo:400:kworker.0 00000100:00100000:2.0:1784938168.892531:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938168.892665:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938168.892708:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938168.893735:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514624 00000100:00100000:1.0:1784938168.893754:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514624 00000100:00100000:1.0:1784938168.893840:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514496 00000100:00100000:1.0:1784938168.893843:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514496 00000100:00100000:1.0:1784938168.893869:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 133 00000100:00100000:1.0:1784938168.893889:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065514624:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938168.894008:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065514624:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 130us (1492us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.894017:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 133 00000100:00100000:1.0:1784938168.894035:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 134 00000100:00100000:1.0:1784938168.894054:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065514496:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938168.894079:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065514496:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 37us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.894100:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 134 00000100:00100000:1.0:1784938168.894122:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514752 00000100:00100000:1.0:1784938168.894126:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514752 00000100:00100000:1.0:1784938168.894157:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 72 00000100:00100000:1.0:1784938168.894164:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065514752:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938168.894191:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065514752:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938168.894196:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 72 00000100:00100000:1.0:1784938168.894518:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065514624:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938168.894534:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065514496:192.168.201.158@tcp:400:kworker.0 00010000:00080000:1.0:1784938168.894588:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa05af4fb7b80 x1871643065514752/t0(0) o400->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 224/224 e 0 to 0 dl 1784938184 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938168.894601:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065514752:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938168.895016:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938168.895034:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065514880:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938168.895260:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938168.895286:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065514880 00000100:00100000:3.0:1784938168.895304:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065514880 00000100:00100000:3.0:1784938168.895351:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 135 00000100:00100000:3.0:1784938168.895359:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065514880:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938168.895399:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065514880:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 41us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.895407:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 135 00000100:00100000:3.0:1784938168.895508:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065514880:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938168.895560:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1784938168.895569:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065515008:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938168.895658:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938168.895685:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065515008 00000100:00100000:3.0:1784938168.895690:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065515008 00000100:00100000:3.0:1784938168.895722:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 73 00000100:00100000:3.0:1784938168.895729:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065515008:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938168.895761:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065515008:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938168.895767:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 73 00000100:00100000:3.0:1784938168.895850:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065515008:192.168.201.158@tcp:400:kworker.0 00000100:00080000:0.0:1784938168.896776:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938168.896784:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938168.896786:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1784938169.145968:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784938169.202397:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938169.269764:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938169.269868:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938169.269911:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938169.269966:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048700032 00000100:00100000:3.0:1784938169.269979:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048700032 00000100:00100000:3.0:1784938169.270060:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699904 00000100:00100000:3.0:1784938169.270063:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699904 00000100:00100000:3.0:1784938169.270093:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:3.0:1784938169.270125:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048700032:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938169.270260:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048700032:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 137us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938169.270270:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:3.0:1784938169.270318:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:3.0:1784938169.270325:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2358:x1871643048699904:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938169.270357:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2358:x1871643048699904:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938169.270363:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00080000:3.0:1784938169.272457:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938169.276742:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048699776 00000100:00100000:2.0:1784938169.276768:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048699776 00000100:00100000:2.0:1784938169.277375:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 286 00000100:00100000:2.0:1784938169.277401:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048699776:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938169.277534:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048699776:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 139us (7787us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938169.277544:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 286 00000100:00100000:2.0:1784938169.395271:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065515136:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938169.396480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938169.396715:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065515136 00000100:00100000:1.0:1784938169.396727:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065515136 00000100:00100000:1.0:1784938169.396792:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 61 00000100:00100000:1.0:1784938169.396803:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065515136:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938169.396851:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938169.396914:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065515136:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 113us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938169.396923:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 61 00000100:00100000:2.0:1784938169.402207:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065515136:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:1.0:1784938170.229802:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938170.402841:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.403546:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048700160 00000100:00100000:3.0:1784938170.403562:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048700160 00000100:00100000:3.0:1784938170.403657:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1784938170.403672:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10241:x1871643048700160:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938170.403701:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938170.403727:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39ae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978a2 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.403815:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.403833:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1784938170.404045:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938170.405046:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405087:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405107:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405119:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405639:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405649:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405656:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405662:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87de00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938170.405668:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405675:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405691:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861100) 00010000:00010000:3.0:1784938170.405694:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938170.405698:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405704:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405716:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405726:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405731:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405735:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938170.405738:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405743:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405749:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa05ac3861b00) 00010000:00010000:3.0:1784938170.405751:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938170.405754:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405759:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39bc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405817:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39ae lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978a2 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.405829:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861100) 00010000:00010000:3.0:1784938170.405831:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938170.405835:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39ae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978a2 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.406011:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d000, rc 0) 00000100:00100000:3.0:1784938170.406168:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10241:x1871643048700160:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2498us (3340us total) trans 0 rc 301/301 00000100:00100000:3.0:1784938170.406178:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:1.0:1784938170.422897:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.430413:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048700416 00000100:00100000:3.0:1784938170.430436:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048700416 00000100:00100000:3.0:1784938170.430535:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:3.0:1784938170.430546:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10241:x1871643048700416:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:3.0:1784938170.430628:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938170.430664:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec3968 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89788d expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.430691:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861100) 00010000:00010000:3.0:1784938170.430706:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938170.431529:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.431549:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.431562:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.431574:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.431581:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.431587:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938170.438091:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1784938170.438122:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.438136:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.438144:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.438151:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938170.438157:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.438166:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.438188:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:3.0:1784938170.438191:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938170.438197:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.438204:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39c3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938170.439069:0:7211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c8e6f48 reply state 0000000053394319 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938170.439086:0:7211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938170.439399:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:10241:x1871643048700416:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 8846us (16507us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784938170.439411:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00010000:00010000:1.0:1784938170.451465:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.451489:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.451499:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.451506:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938170.451513:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.451522:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.451543:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa05ac3861700) 00010000:00010000:1.0:1784938170.451547:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938170.451553:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.451559:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec39ca lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.555588:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.555751:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048700544 00000100:00100000:3.0:1784938170.555762:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048700544 00000100:00100000:3.0:1784938170.555846:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1784938170.555858:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:10249:x1871643048700544:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:3.0:1784938170.555892:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938170.555917:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978a9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.556027:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec39d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.556042:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec39d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.556052:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec39d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938170.556119:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784938170.556123:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938170.556156:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec39d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.556179:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978a9 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.556195:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec39d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978a9 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.556202:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:3.0:1784938170.556205:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938170.556208:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c000, rc 0) 00000100:00100000:0.0:1784938170.556471:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:10249:x1871643048700544:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 613us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938170.556480:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:1.0:1784938170.612360:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.615126:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048700672 00000100:00100000:3.0:1784938170.615173:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048700672 00000100:00100000:3.0:1784938170.615298:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1784938170.615322:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:10255:x1871643048700672:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938170.615349:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938170.615377:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978b0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615465:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615482:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615496:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615513:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615520:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615526:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615656:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec39f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615663:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec39f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615670:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec39f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938170.615713:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1784938170.615716:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938170.615762:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec39f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615776:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615783:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615790:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615796:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938170.615800:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615808:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615821:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:3.0:1784938170.615824:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938170.615829:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615834:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec39e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615848:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615862:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615868:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615873:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938170.615875:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615881:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615887:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffffa05ac3861100) 00010000:00010000:3.0:1784938170.615889:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938170.615892:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.615897:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec39ed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.617073:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec39df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b0 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.617101:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec39f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b0 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.617110:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938170.617113:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1784938170.617125:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c600, rc 0) 00000100:00100000:3.0:1784938170.617211:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:10255:x1871643048700672:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1901us (4868us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.617238:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1784938170.622660:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.622788:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048700928 00000100:00100000:1.0:1784938170.622801:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048700928 00000100:00100000:1.0:1784938170.622883:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:1.0:1784938170.622897:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:10255:x1871643048700928:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784938170.623011:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938170.623060:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec39fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978b7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.623292:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.623310:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.623516:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.625529:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.625556:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.625570:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938170.626810:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1784938170.627019:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627033:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627043:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627095:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627113:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627121:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627128:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938170.627133:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627140:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627154:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938170.627157:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938170.627162:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627169:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec3a02 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938170.627182:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000467085b reply state 000000007c5cb3b6 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.627191:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1784938170.627273:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec39fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627292:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.627313:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:1.0:1784938170.627316:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938170.627332:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990000, rc 0) 00000100:00100000:1.0:1784938170.627417:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10255:x1871643048700928:12345-192.168.201.58@tcp:101:bash.0 Request processed in 4522us (4771us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1784938170.627426:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00010000:00010000:2.0:1784938170.632951:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.632975:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.632983:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.632990:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991c00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938170.632996:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.633005:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.633028:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac7d1d200) 00010000:00010000:2.0:1784938170.633031:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938170.633038:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.633064:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec3a09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938170.637732:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.637989:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048701056 00000100:00100000:1.0:1784938170.638003:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048701056 00000100:00100000:1.0:1784938170.638071:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1784938170.638186:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2354:x1871643048701056:12345-192.168.201.58@tcp:8:bash.0 00010000:00080000:1.0:1784938170.638480:0:8127:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp t0 exp 0000000000000000 cur 379 last 0 00000020:00000080:1.0:1784938170.638512:0:8127:0:(genops.c:1406:class_connect()) connect: client 8bbc0047-63c1-4cac-b5e6-ede401808e2e, cookie 0xea86628a8aec3a1e 00002000:00100000:1.0:1784938170.638523:0:8127:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8bbc0047-63c1-4cac-b5e6-ede401808e2e/ffffa05ae7d12800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938170.638548:0:8127:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938170.639916:0:8127:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938170.639969:0:8127:0:(import.c:65:import_set_state_nolock()) ffffa05ae7d12000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938170.640859:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2354:x1871643048701056:12345-192.168.201.58@tcp:8:bash.0 Request processed in 2774us (3139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938170.640872:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1784938170.653106:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.653489:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048701184 00000100:00100000:3.0:1784938170.653504:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048701184 00000100:00100000:3.0:1784938170.653688:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784938170.653701:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:0:x1871643048701184:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938170.653728:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938170.653764:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978be expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938170.653798:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1784938170.653821:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=379s v=(0 0) 00010000:00010000:3.0:1784938170.653826:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938170.653839:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 7 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.653864:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 7 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.653880:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87de00, rc 0) 00000100:00100000:3.0:1784938170.653968:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:0:x1871643048701184:12345-192.168.201.58@tcp:101:bash.0 Request processed in 270us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.653975:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00080000:0.0:1784938170.654788:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938170.658780:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.658963:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048701312 00000100:00100000:1.0:1784938170.658977:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048701312 00000100:00100000:1.0:1784938170.659056:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784938170.659068:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:10255:x1871643048701312:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784938170.659118:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938170.659147:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978c5 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.659191:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.659202:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938170.659207:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938170.659263:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.659306:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.659498:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.659518:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1871643065515264:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938170.659644:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938170.662465:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1871643065515264:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938170.662518:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.662544:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991a00, rc 0) 00000100:00100000:1.0:1784938170.662691:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:10255:x1871643048701312:12345-192.168.201.58@tcp:101:bash.0 Request processed in 3624us (3925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938170.662702:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1784938170.669832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.670310:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048701440 00000100:00100000:1.0:1784938170.670324:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048701440 00010000:00010000:1.0:1784938170.670381:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.670437:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784938170.670449:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048701440:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938170.670468:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938170.670500:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.670516:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.670547:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c9452c4/0xea86628a8aec3a25 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978be expref: 8 pid: 6604 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.670569:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938170.670574:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938170.670585:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.670597:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.671290:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.671310:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5791:1871643065515392:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784938170.671423:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938170.678862:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938170.679251:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5791:1871643065515392:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784938170.679287:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938170.679356:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048701440:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 8908us (9537us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.679370:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:3.0:1784938170.680314:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048701696 00000100:00100000:3.0:1784938170.680326:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048701696 00000100:00100000:3.0:1784938170.680406:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:3.0:1784938170.680418:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10255:x1871643048701696:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1784938170.680862:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10255:x1871643048701696:12345-192.168.201.58@tcp:35:bash.0 Request processed in 446us (2012us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1784938170.680870:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784938170.764044:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.764193:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048701952 00000100:00100000:3.0:1784938170.764206:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048701952 00000100:00100000:3.0:1784938170.764326:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:3.0:1784938170.764338:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10265:x1871643048701952:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938170.764371:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938170.764400:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3a33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978cc expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938170.764555:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1784938170.765096:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3a33 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978cc expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.765114:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:2.0:1784938170.765117:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938170.765122:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3a33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978cc expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.765140:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c800, rc 0) 00000100:00100000:2.0:1784938170.765262:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10265:x1871643048701952:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 925us (1231us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1784938170.765270:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:2.0:1784938170.767856:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.768029:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048702208 00000100:00100000:1.0:1784938170.768043:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048702208 00000100:00100000:1.0:1784938170.768119:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784938170.768134:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10265:x1871643048702208:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938170.768730:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:10265:x1871643048702208:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 598us (885us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1784938170.768740:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784938170.832415:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938170.832538:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048702336 00000100:00100000:0.0:1784938170.832551:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048702336 00000100:00100000:0.0:1784938170.832639:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784938170.832651:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:10271:x1871643048702336:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938170.832684:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938170.832714:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a41 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978d3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.832803:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.832820:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.832832:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938170.832907:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1784938170.832946:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938170.832983:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.833028:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a41 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978d3 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.833052:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978d3 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.833063:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938170.833067:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938170.833071:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031600, rc 0) 00000100:00100000:0.0:1784938170.833154:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee237800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:10271:x1871643048702336:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 505us (754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938170.833163:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1784938170.838264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.838352:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048702592 00000100:00100000:1.0:1784938170.838364:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048702592 00000100:00100000:1.0:1784938170.838433:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784938170.838443:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:10271:x1871643048702592:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784938170.838471:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938170.838498:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec3a4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978da expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.838633:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3a56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.838659:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.838672:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3a56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938170.838686:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1784938170.838830:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec3a4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978da expref: 20 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.838850:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3a56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978da expref: 19 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.838859:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:1.0:1784938170.838862:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938170.838866:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991400, rc 0) 00000100:00100000:1.0:1784938170.838952:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10271:x1871643048702592:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 510us (742us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1784938170.838960:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784938170.845118:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938170.845169:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938170.845362:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048702848 00000100:00100000:0.0:1784938170.845374:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048702848 00000100:00100000:0.0:1784938170.845454:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784938170.845466:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10271:x1871643048702848:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938170.845501:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938170.845530:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978e1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.845662:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3a6b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.845681:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.845705:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3a6b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938170.845721:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784938170.845879:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e1 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.845903:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e1 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.845913:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:0.0:1784938170.845916:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784938170.845920:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031800, rc 0) 00000100:00100000:0.0:1784938170.846011:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10271:x1871643048702848:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 546us (907us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784938170.846019:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:3.0:1784938170.849279:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048702976 00000100:00100000:3.0:1784938170.849300:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048702976 00000100:00100000:3.0:1784938170.849476:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784938170.849488:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2355:x1871643048702976:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938170.849510:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938170.849543:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3a56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978da expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.849567:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:3.0:1784938170.849573:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938170.849669:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:2355:x1871643048702976:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 183us (4498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938170.849696:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784938170.854395:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.854554:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048703104 00000100:00100000:3.0:1784938170.854567:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048703104 00000100:00100000:3.0:1784938170.854640:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:3.0:1784938170.854652:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048703104:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:3.0:1784938170.854717:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.854742:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.854752:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938170.854757:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938170.854762:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.854812:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.854829:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 7 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938170.854847:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1871643065515520:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938170.855030:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad8250900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938170.858937:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1871643065515520:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938170.859000:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938170.859071:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.859276:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048703232 00000100:00100000:1.0:1784938170.859286:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048703232 00002000:00100000:1.0:1784938170.859345:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa05aee13ca80 x1871643048703232/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:401/0 lens 504/0 e 0 to 0 dl 1784938181 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938170.859357:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aee13ca80 with x1871643048703232 ext(0->12) 00010000:00010000:1.0:1784938170.859367:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 8 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.859401:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 8 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938170.859410:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05aee13ca80 00000100:00100000:1.0:1784938170.859456:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784938170.859467:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048703232:12345-192.168.201.58@tcp:4:lfs.0 00000001:00100000:3.0:1784938170.884371:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000100:00100000:2.0:1784938170.885831:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2355:x1871643048703232:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 26356us (26760us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1784938170.885854:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00002000:00100000:2.0:1784938170.885872:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffffa05aee13ca80 x1871643048703232/t4294967299(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:401/0 lens 504/448 e 0 to 0 dl 1784938181 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938170.885885:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aee13ca80 with x1871643048703232 ext(0->12) 00010000:00010000:2.0:1784938170.885899:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 9 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.885923:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 9 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938170.885942:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05aee13ca80 00000100:00100000:1.0:1784938170.889118:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938170.889251:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048703360 00000100:00100000:0.0:1784938170.889265:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048703360 00010000:00010000:0.0:1784938170.889317:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 9 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938170.889404:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:0.0:1784938170.889416:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2357:x1871643048703360:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938170.889438:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1784938170.889465:0:8373:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1784938170.889485:0:8373:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1784938171 00002000:00010000:0.0:1784938170.889487:0:8373:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1784938171 00002000:00010000:0.0:1784938170.889490:0:8373:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1784938171 00010000:00010000:0.0:1784938170.889498:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 9 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.889513:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 9 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.889544:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec3a2c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978c5 expref: 9 pid: 6602 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.889565:0:8373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938170.889570:0:8373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938170.889577:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.889588:0:8373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.889773:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938170.889840:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2357:x1871643048703360:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 425us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938170.889849:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00010000:00010000:1.0:1784938170.890945:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.890963:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891001:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891073:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891083:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891091:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938170.891096:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891124:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891144:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.891152:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a8595dc9/0xea86628a8aec3a79 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.891346:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048703104:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 36692us (36961us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938170.891356:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1784938170.894374:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938170.894480:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048703616 00000100:00100000:3.0:1784938170.894493:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048703616 00000100:00100000:3.0:1784938170.894562:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784938170.894573:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10271:x1871643048703616:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:3.0:1784938170.894676:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3a6b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e1 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938170.895096:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:3.0:1784938170.895163:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1784938170.895966:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:3.0:1784938170.896044:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.896066:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.896076:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.896123:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938170.896143:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 24 pid: 5805 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938170.896178:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1871643065515648:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938170.896345:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dac00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938170.899810:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938170.900008:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1871643065515648:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938170.900058:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.900264:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048703744 00000100:00100000:1.0:1784938170.900274:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048703744 00010000:00010000:1.0:1784938170.900325:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 25 pid: 5805 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938170.900369:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1784938170.900380:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:2355:x1871643048703744:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938170.900400:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938170.900408:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 25 pid: 5805 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.900422:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 25 pid: 5805 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.900457:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b7 expref: 25 pid: 5805 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.900475:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:1.0:1784938170.900480:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.900492:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.900500:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938170.900522:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938170.900603:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:2355:x1871643048703744:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 217us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938170.900611:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00010000:00010000:0.0:1784938170.901383:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938170.901395:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938170.901572:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1784938170.901846:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1784938170.902406:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065515776:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784938170.902507:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938170.906149:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938170.906290:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065515776 00000100:00100000:2.0:1784938170.906307:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065515776 00000100:00100000:2.0:1784938170.906410:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938170.906424:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065515776:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938170.906578:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065515776:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 Request processed in 158us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.906588:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00080000:0.0:1784938170.907403:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938170.907834:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065515776:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784938170.912484:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1784938170.912715:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065515904:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938170.912913:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe630c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938170.913492:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938170.913590:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065515904 00000100:00100000:3.0:1784938170.913604:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065515904 00000100:00100000:3.0:1784938170.915267:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:3.0:1784938170.915295:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065515904:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1784938170.918545:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1871643065515904:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 Request processed in 3248us (5040us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1784938170.918582:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784938170.919985:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065515904:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1784938170.922249:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1784938170.922360:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.922376:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.922386:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.922394:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938170.922399:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.922408:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.922432:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:2.0:1784938170.922436:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784938170.922444:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.922451:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3a80 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938170.922749:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784938170.924549:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1784938170.924574:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 379867358113ns, next at 380867353665ns, rc = 0 00000001:00080000:2.0:1784938170.924623:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1784938170.924702:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac7d1d500) 00010000:00010000:2.0:1784938170.924708:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784938170.924721:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3a6b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e1 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938170.924896:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10271:x1871643048703616:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 30323us (30534us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1784938170.924908:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000020:00080000:2.0:1784938170.924915:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1784938170.929392:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938170.929508:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048703872 00000100:00100000:2.0:1784938170.929522:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048703872 00000100:00100000:2.0:1784938170.929614:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1784938170.929626:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10271:x1871643048703872:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938170.929660:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938170.929694:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3a87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978e8 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.929782:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e8 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.929800:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3a87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e8 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938170.929825:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938170.929828:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938170.929832:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893a00, rc 0) 00000100:00100000:2.0:1784938170.929915:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10271:x1871643048703872:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 291us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938170.929951:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:3.0:1784938170.937503:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938170.938024:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048704128 00000100:00100000:1.0:1784938170.938039:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048704128 00000100:00100000:1.0:1784938170.938117:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938170.938128:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10271:x1871643048704128:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938170.938478:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:10271:x1871643048704128:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 350us (988us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1784938170.938487:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938171.003424:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938171.003551:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048704384 00000100:00100000:0.0:1784938171.003564:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048704384 00000100:00100000:0.0:1784938171.003656:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784938171.003669:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:10281:x1871643048704384:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938171.003703:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938171.003731:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978ef expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938171.003877:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1784938171.004057:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a8e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978ef expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.004076:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:0.0:1784938171.004079:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938171.004085:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3a8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978ef expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.004119:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031400, rc 0) 00000100:00100000:0.0:1784938171.004201:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee237480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10281:x1871643048704384:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 535us (794us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1784938171.004209:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:3.0:1784938171.007651:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.007750:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048704512 00000100:00100000:2.0:1784938171.007764:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048704512 00000100:00100000:2.0:1784938171.007840:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1784938171.007852:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10281:x1871643048704512:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:2.0:1784938171.008016:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008038:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008052:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008069:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008075:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008082:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008205:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008249:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008257:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938171.008324:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008338:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008345:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008351:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008357:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938171.008362:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008370:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008385:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938171.008388:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938171.008393:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008400:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3a9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008414:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008420:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008433:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008438:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938171.008440:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008446:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008454:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886bc00) 00010000:00010000:2.0:1784938171.008456:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938171.008459:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008465:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008480:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008486:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008492:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008497:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938171.008499:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008513:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008521:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938171.008522:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938171.008525:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.008530:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3aaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.008627:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10281:x1871643048704512:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 776us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.008636:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1784938171.012400:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938171.012533:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048704768 00000100:00100000:1.0:1784938171.012563:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048704768 00000100:00100000:1.0:1784938171.012644:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938171.012655:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10281:x1871643048704768:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938171.013001:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10281:x1871643048704768:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 346us (615us total) trans 4294967328 rc 0/0 00000100:00100000:1.0:1784938171.013019:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938171.046449:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938171.046558:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048705024 00000100:00100000:3.0:1784938171.046572:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048705024 00000100:00100000:3.0:1784938171.046822:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1784938171.046836:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10284:x1871643048705024:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938171.046870:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938171.046899:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978f6 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047081:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047099:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047133:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047150:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047158:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047164:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047448:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047458:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047465:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938171.047477:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784938171.047600:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047936:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047944:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047949:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938171.047964:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047973:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.047989:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938171.047992:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938171.047998:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048076:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048094:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048100:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048106:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048111:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938171.048114:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048119:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048126:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac3861300) 00010000:00010000:3.0:1784938171.048129:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938171.048137:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048143:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048205:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048379:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.048388:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:3.0:1784938171.048391:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938171.048393:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d000, rc 0) 00000100:00100000:3.0:1784938171.048488:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10284:x1871643048705024:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1653us (2053us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1784938171.048498:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1784938171.052309:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.052467:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048705152 00000100:00100000:2.0:1784938171.052481:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048705152 00000100:00100000:2.0:1784938171.052555:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784938171.052567:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10284:x1871643048705152:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784938171.052678:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052700:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052714:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052748:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052778:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052785:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052792:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938171.052797:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052806:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052821:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938171.052824:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938171.052830:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.052835:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.052942:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10284:x1871643048705152:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 375us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.052950:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784938171.055661:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.055763:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048705408 00000100:00100000:2.0:1784938171.055777:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048705408 00000100:00100000:2.0:1784938171.055855:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938171.055868:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10284:x1871643048705408:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938171.056252:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:10284:x1871643048705408:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 347us (568us total) trans 4294967330 rc 0/0 00000100:00100000:2.0:1784938171.056274:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00010000:00010000:0.0:1784938171.249480:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938171.317342:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938171.318091:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048705664 00000100:00100000:0.0:1784938171.318107:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048705664 00000100:00100000:0.0:1784938171.318205:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1784938171.318245:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:10315:x1871643048705664:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784938171.318281:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938171.318313:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3adb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8978fd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.318452:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.318471:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.318486:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938171.318500:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1784938171.318731:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978fd expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.318755:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978fd expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.318773:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938171.318777:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938171.318782:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938171.318873:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:10315:x1871643048705664:12345-192.168.201.58@tcp:101:cat.0 Request processed in 657us (1544us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1784938171.318881:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1784938171.325083:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938171.325159:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.325392:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048705792 00000100:00100000:2.0:1784938171.325401:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048705792 00000100:00100000:2.0:1784938171.325462:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1784938171.325469:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:2358:x1871643048705792:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938171.325481:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938171.325501:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978fd expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.325518:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938171.325521:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938171.325564:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:2358:x1871643048705792:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 97us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.325569:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1784938171.325985:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048706048 00000100:00100000:0.0:1784938171.325990:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048706048 00000100:00100000:0.0:1784938171.326028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784938171.326036:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:10315:x1871643048706048:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1784938171.326308:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:10315:x1871643048706048:12345-192.168.201.58@tcp:35:cat.0 Request processed in 272us (1148us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1784938171.326316:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784938171.374077:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.374187:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048706304 00000100:00100000:2.0:1784938171.374197:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048706304 00000100:00100000:2.0:1784938171.374286:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784938171.374297:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:10321:x1871643048706304:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:2.0:1784938171.374323:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938171.374326:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784938171.374354:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978d3 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.374375:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938171.374380:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938171.374396:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3af0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897904 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.374517:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.374532:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.374542:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.374580:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 36 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.374594:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 36 pid: 5805 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.374683:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065516032:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938171.374854:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938171.379703:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938171.379983:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048706432 00000100:00100000:0.0:1784938171.379994:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048706432 00010000:00010000:0.0:1784938171.380057:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 37 pid: 5805 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938171.380104:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784938171.380115:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:2356:x1871643048706432:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938171.380132:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938171.380140:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 37 pid: 5805 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.380154:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 37 pid: 5805 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.380192:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938171.380198:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.380208:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.380236:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.380256:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938171.380311:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:2356:x1871643048706432:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 197us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938171.380318:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00010000:00010000:3.0:1784938171.381104:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3ac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978f6 expref: 36 pid: 5805 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938171.381125:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065516032:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938171.381150:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.381172:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.381178:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938171.381203:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1784938171.381464:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3af0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 37 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.381480:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 36 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.381488:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:3.0:1784938171.381491:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938171.381495:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:3.0:1784938171.381591:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:10321:x1871643048706304:12345-192.168.201.58@tcp:101:dd.0 Request processed in 7296us (7523us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1784938171.381615:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:1.0:1784938171.387422:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938171.387523:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048706688 00000100:00100000:0.0:1784938171.387534:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048706688 00000100:00100000:0.0:1784938171.387891:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784938171.387903:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:10321:x1871643048706688:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1784938171.388250:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.388269:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.388281:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938171.388333:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1784938171.388360:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a1d5112 reply state 000000002b8c6972 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938171.388383:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938171.388496:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee237b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:10321:x1871643048706688:12345-192.168.201.58@tcp:36:dd.0 Request processed in 594us (1082us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1784938171.388503:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000020:00080000:0.0:1784938171.388508:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784938171.393351:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.393368:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.393376:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.393382:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938171.393400:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.393409:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.393427:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:3.0:1784938171.393430:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938171.393435:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.393441:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3b05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938171.558410:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000004:00080000:2.0:1784938171.558471:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1784938171.558499:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05aee2dad80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1784938171.558505:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ac82dfd00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05aee2da6c0 00000020:00080000:2.0:1784938171.558509:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ac82dfc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05afb9fac00 00000020:00080000:0.0:1784938171.558785:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:2.0:1784938171.558873:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938171.558903:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065516160:192.168.201.158@tcp:6:osp-syn-0-0.0 00000020:00080000:0.0:1784938171.558949:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1784938171.559488:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938171.559926:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065516160 00000100:00100000:2.0:1784938171.559939:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065516160 00000100:00100000:2.0:1784938171.560033:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 24 00000100:00100000:2.0:1784938171.560043:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3324:x1871643065516160:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938171.560077:0:8127:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1784938171.560114:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a63febb, atime: 0x6a63febb, ctime: 0x6a63febb, blocks: 0x1 00010000:00010000:2.0:1784938171.560122:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.560141:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=380s v=(0 0) 00010000:00010000:2.0:1784938171.560146:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938171.560153:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.560172:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.560183:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.560192:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.560249:0:8127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938171.561838:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938171.561852:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.561865:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938171.561870:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.561881:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.561902:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.561910:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec3b0c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.561945:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938171.561947:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938171.561961:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938171.562253:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3324:x1871643065516160:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 Request processed in 2206us (2764us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1784938171.562265:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 24 00000004:00080000:2.0:1784938171.564280:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aee237100/2, rc 0, transno 4294967301 00000100:00100000:2.0:1784938171.564299:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee237100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065516160:192.168.201.158@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938171.745048:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938171.745264:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048706816 00000100:00100000:3.0:1784938171.745275:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048706816 00000100:00100000:3.0:1784938171.745395:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:3.0:1784938171.745407:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:10335:x1871643048706816:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:3.0:1784938171.745435:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938171.745459:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3b13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89790b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.745531:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.745545:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.745557:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.745572:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.745609:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.745616:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.746015:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.746028:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 12 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.746036:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.746071:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 12 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.746085:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 12 pid: 7211 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938171.746100:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff972d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065516288:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938171.746209:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938171.751330:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.751421:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048707072 00000100:00100000:2.0:1784938171.751430:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048707072 00000100:00100000:2.0:1784938171.751533:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784938171.751544:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:5571:x1871643048707072:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784938171.752268:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:5571:x1871643048707072:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 724us (946us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1784938171.752278:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784938171.752426:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff972d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065516288:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938171.752452:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938171.755585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938171.755851:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048707200 00000100:00100000:2.0:1784938171.755863:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048707200 00010000:00010000:2.0:1784938171.755923:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 14 pid: 7211 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938171.755971:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784938171.755981:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2355:x1871643048707200:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938171.755998:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938171.756005:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 14 pid: 7211 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.756019:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 14 pid: 7211 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.756042:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3af7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897904 expref: 14 pid: 7211 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.756060:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938171.756067:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.756091:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.756099:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.756135:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938171.756197:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2355:x1871643048707200:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 216us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.756206:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00010000:00010000:0.0:1784938171.756316:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756325:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938171.756373:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1784938171.756378:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938171.756418:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756431:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756442:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756450:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756457:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756463:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938171.756468:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756476:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756486:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938171.756495:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938171.756500:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756507:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3b1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756519:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756526:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756533:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756539:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938171.756542:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756549:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756557:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac3861300) 00010000:00010000:0.0:1784938171.756560:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938171.756563:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756569:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3b21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756761:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3b13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89790b expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756789:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89790b expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938171.756797:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938171.756799:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938171.756802:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d600, rc 0) 00000100:00100000:0.0:1784938171.756830:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:10335:x1871643048706816:12345-192.168.201.58@tcp:101:stat.0 Request processed in 11428us (11854us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938171.756839:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1784938171.853367:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938171.853486:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048707456 00000100:00100000:3.0:1784938171.853521:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048707456 00000100:00100000:3.0:1784938171.853613:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:3.0:1784938171.853625:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:10341:x1871643048707456:12345-192.168.201.58@tcp:36:truncate.0 00010000:00010000:3.0:1784938171.853714:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938171.853752:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3b28 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89790b expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.853775:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:3.0:1784938171.853781:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938171.854683:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.854703:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938171.854715:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938171.854787:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1784938171.854816:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f620bbb1 reply state 0000000032e98e0a transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938171.854827:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938171.855388:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10341:x1871643048707456:12345-192.168.201.58@tcp:36:truncate.0 Request processed in 1761us (2032us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1784938171.855398:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000020:00080000:3.0:1784938171.855406:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1784938171.862773:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.862798:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.862806:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.862812:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938171.862818:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.862826:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.862848:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938171.862850:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938171.862856:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938171.862887:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3b2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938171.953996:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938171.954036:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065516416:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938171.954931:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938171.955337:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065516416 00000100:00100000:2.0:1784938171.955351:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065516416 00000100:00100000:2.0:1784938171.955428:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 62 00000100:00100000:2.0:1784938171.955440:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065516416:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:2.0:1784938171.955720:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938171.955797:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065516416:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 358us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938171.955805:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 62 00000100:00100000:0.0:1784938171.957568:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065516416:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938172.036270:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.036597:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048707584 00000100:00100000:2.0:1784938172.036610:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048707584 00000100:00100000:2.0:1784938172.036719:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1784938172.036732:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10355:x1871643048707584:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:2.0:1784938172.036765:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938172.036793:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3b36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897912 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.036879:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.036899:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.036926:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.036968:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.036976:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.036982:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037622:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037635:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037643:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938172.037689:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1784938172.037695:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938172.037723:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037737:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037747:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037754:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037773:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037780:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938172.037784:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037792:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037807:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938172.037810:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938172.037815:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037821:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b3d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037835:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037841:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037847:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037853:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938172.037856:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037872:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037881:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886b200) 00010000:00010000:2.0:1784938172.037883:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938172.037887:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037893:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037947:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3b36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 15 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037962:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 14 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.037970:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938172.037972:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938172.037975:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00080000:0.0:1784938172.038193:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938172.039650:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10355:x1871643048707584:12345-192.168.201.58@tcp:101:stat.0 Request processed in 1346us (1866us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938172.039668:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:0.0:1784938172.132539:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938172.132671:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048707840 00000100:00100000:3.0:1784938172.132683:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048707840 00000100:00100000:3.0:1784938172.132761:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:3.0:1784938172.132771:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10365:x1871643048707840:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938172.132795:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938172.132819:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897919 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938172.133146:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1784938172.133452:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b52 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897919 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.133467:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:3.0:1784938172.133469:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938172.133473:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897919 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.133485:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87de00, rc 0) 00000100:00100000:3.0:1784938172.133546:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10365:x1871643048707840:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 778us (1022us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1784938172.133552:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1784938172.141418:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938172.141570:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048708096 00000100:00100000:0.0:1784938172.141582:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048708096 00000100:00100000:0.0:1784938172.141646:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938172.141655:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10365:x1871643048708096:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938172.142265:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:10365:x1871643048708096:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 609us (863us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1784938172.142273:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938172.235888:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938172.236207:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048708352 00000100:00100000:3.0:1784938172.236250:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048708352 00000100:00100000:3.0:1784938172.236332:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1784938172.236346:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:10371:x1871643048708352:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938172.236384:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938172.236413:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897920 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.236594:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.236612:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 17 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.236636:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.236688:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 17 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.236704:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 17 pid: 7211 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938172.236720:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff972300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065516544:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938172.236857:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938172.243190:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938172.243464:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048708480 00000100:00100000:0.0:1784938172.243478:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048708480 00010000:00010000:0.0:1784938172.243556:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 18 pid: 7211 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938172.243610:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:0.0:1784938172.243633:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:2356:x1871643048708480:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938172.243653:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938172.243661:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 18 pid: 7211 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.243678:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 18 pid: 7211 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.243708:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938172.243715:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.243727:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.243737:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.243761:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938172.243846:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:2356:x1871643048708480:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 226us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938172.243855:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00010000:00010000:3.0:1784938172.244468:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897912 expref: 17 pid: 7211 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938172.244491:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff972300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065516544:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938172.244520:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.244530:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.244552:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938172.244578:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1784938172.244964:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.244984:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.244993:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:3.0:1784938172.244997:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938172.245001:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c400, rc 0) 00000100:00100000:3.0:1784938172.245110:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:10371:x1871643048708352:12345-192.168.201.58@tcp:101:bash.0 Request processed in 8766us (9236us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1784938172.245120:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:1.0:1784938172.263725:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938172.269190:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048708736 00000100:00100000:3.0:1784938172.269233:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048708736 00000100:00100000:2.0:1784938172.272004:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:2.0:1784938172.272024:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:10371:x1871643048708736:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:2.0:1784938172.276348:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.276405:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.276422:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938172.276555:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1784938172.276615:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000081c987a4 reply state 000000009d33e35f transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938172.277734:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938172.277936:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10371:x1871643048708736:12345-192.168.201.58@tcp:36:bash.0 Request processed in 5910us (14221us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1784938172.277947:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000020:00080000:2.0:1784938172.280449:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938172.280576:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.280593:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.280635:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.280643:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938172.280649:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.280659:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.280681:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938172.280685:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938172.280691:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.280699:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3b75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938172.281605:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938172.291585:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.291877:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048708864 00000100:00100000:2.0:1784938172.291892:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048708864 00000100:00100000:2.0:1784938172.291977:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1784938172.291997:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10371:x1871643048708864:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938172.292032:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938172.292062:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897927 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.292186:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.292206:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.292262:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.292308:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.292324:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 20 pid: 5806 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938172.292342:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065516672:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938172.292778:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63d80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938172.312428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938172.312557:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048708992 00000100:00100000:1.0:1784938172.312571:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048708992 00010000:00010000:1.0:1784938172.312640:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 21 pid: 5806 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938172.312695:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784938172.312707:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff972300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2355:x1871643048708992:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938172.312749:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938172.312758:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 21 pid: 5806 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.312775:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 21 pid: 5806 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.312806:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938172.312812:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.312824:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.312833:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.312858:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938172.313067:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff972300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2355:x1871643048708992:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 361us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938172.313076:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00010000:00010000:2.0:1784938172.313207:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3b67 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897920 expref: 20 pid: 5806 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938172.313277:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065516672:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938172.313307:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.313318:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.313324:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938172.313396:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1784938172.313401:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938172.313428:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.313473:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3b7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897927 expref: 20 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.313489:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897927 expref: 19 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.313498:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938172.313501:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938172.313505:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893400, rc 0) 00000100:00100000:2.0:1784938172.313536:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10371:x1871643048708864:12345-192.168.201.58@tcp:101:bash.0 Request processed in 21542us (21965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938172.313544:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1784938172.317795:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.317881:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048709248 00000100:00100000:2.0:1784938172.317894:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048709248 00000100:00100000:2.0:1784938172.317993:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1784938172.318005:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10371:x1871643048709248:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:2.0:1784938172.318741:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193c050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10371:x1871643048709248:12345-192.168.201.58@tcp:35:bash.0 Request processed in 735us (955us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1784938172.318753:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784938172.440491:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938172.440695:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048709504 00000100:00100000:1.0:1784938172.440708:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048709504 00000100:00100000:1.0:1784938172.440788:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1784938172.440799:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10381:x1871643048709504:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784938172.440830:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938172.440859:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3b8a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89792e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938172.441275:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1784938172.441483:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3b8a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89792e expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.441501:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:1.0:1784938172.441504:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938172.441511:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3b8a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89792e expref: 22 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.441527:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991400, rc 0) 00000100:00100000:1.0:1784938172.441829:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10381:x1871643048709504:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 938us (1258us total) trans 4294967345 rc 301/301 00000100:00100000:1.0:1784938172.441841:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:0.0:1784938172.455301:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938172.455391:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048709632 00000100:00100000:3.0:1784938172.455414:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048709632 00000100:00100000:3.0:1784938172.455488:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:3.0:1784938172.455498:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10381:x1871643048709632:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784938172.455605:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.455624:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.455656:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.455673:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.455681:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.455687:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456386:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456455:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456466:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938172.456520:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456535:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456542:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456550:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456677:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87de00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938172.456683:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456692:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456708:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938172.456711:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938172.456716:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456723:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3b98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456736:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456866:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456873:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456878:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938172.456881:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456888:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456940:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac3861e00) 00010000:00010000:3.0:1784938172.456943:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938172.456947:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456954:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3b9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.456971:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.457697:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.457705:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.457711:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938172.457715:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.457722:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.457732:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:3.0:1784938172.457735:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938172.457738:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.459178:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938172.459355:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10381:x1871643048709632:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 3851us (4063us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938172.459368:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1784938172.462736:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938172.462926:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048709888 00000100:00100000:1.0:1784938172.462939:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048709888 00000100:00100000:1.0:1784938172.463481:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784938172.463495:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10381:x1871643048709888:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938172.464092:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:10381:x1871643048709888:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 597us (1365us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1784938172.464102:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784938172.545165:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.545382:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048710144 00000100:00100000:2.0:1784938172.545735:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048710144 00000100:00100000:2.0:1784938172.545824:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:2.0:1784938172.545836:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:10384:x1871643048710144:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938172.545874:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938172.545912:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897935 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.546029:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.546045:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.546172:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.546192:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.546199:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.546206:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.547877:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3bc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.547906:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.547919:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3bc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938172.547934:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784938172.549785:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549815:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549848:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549856:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938172.549863:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549875:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549907:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938172.549910:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938172.549916:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549924:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3bb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549948:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549954:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549960:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549966:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938172.549969:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549985:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.549993:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886b200) 00010000:00010000:2.0:1784938172.549995:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938172.549998:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.550005:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.550857:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897935 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.550886:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3bc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897935 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.550903:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938172.550906:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938172.550909:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938172.552919:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10384:x1871643048710144:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 7060us (7743us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1784938172.552935:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1784938172.570041:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.570260:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048710272 00000100:00100000:2.0:1784938172.570277:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048710272 00000100:00100000:2.0:1784938172.570358:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1784938172.570370:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10384:x1871643048710272:12345-192.168.201.58@tcp:54:lfs.0 00000100:00100000:0.0:1784938172.570419:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:2.0:1784938172.570499:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570520:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570534:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570565:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570572:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570580:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570586:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938172.570591:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570599:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570611:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938172.570614:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938172.570619:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.570625:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938172.570797:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048710400 00000100:00100000:1.0:1784938172.570809:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048710400 00000100:00100000:1.0:1784938172.570880:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784938172.570892:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:2358:x1871643048710400:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938172.570920:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1784938172.570964:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:10384:x1871643048710272:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 593us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938172.570977:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00010000:00010000:1.0:1784938172.570981:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3bc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897935 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.571011:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938172.571017:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938172.571067:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:2358:x1871643048710400:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 177us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938172.571075:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1784938172.574061:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.574162:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048710656 00000100:00100000:2.0:1784938172.574175:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048710656 00000100:00100000:2.0:1784938172.576029:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1784938172.576061:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:10384:x1871643048710656:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938172.578094:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10384:x1871643048710656:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 2035us (4032us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1784938172.578109:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1784938172.714938:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938172.715137:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048710912 00000100:00100000:1.0:1784938172.715151:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048710912 00000100:00100000:1.0:1784938172.716573:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:1.0:1784938172.716592:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10402:x1871643048710912:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:1.0:1784938172.716649:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938172.716679:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3bd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89793c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.716814:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3bde lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.716834:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.716848:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3bde lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938172.716864:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1784938172.717049:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec3bd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89793c expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.717097:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3bde lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89793c expref: 26 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.717106:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938172.717109:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784938172.717114:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991a00, rc 0) 00000100:00100000:1.0:1784938172.717213:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10402:x1871643048710912:12345-192.168.201.58@tcp:101:cat.0 Request processed in 626us (2288us total) trans 4294967349 rc 0/0 00000100:00100000:1.0:1784938172.717273:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1784938172.743539:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938172.743868:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048711040 00000100:00100000:3.0:1784938172.743881:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048711040 00000100:00100000:3.0:1784938172.744038:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1784938172.744051:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10403:x1871643048711040:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938172.744088:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938172.744117:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3bec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897943 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.744208:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3bf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.744262:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.744276:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938172.746709:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1784938172.746722:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938172.746857:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3bf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.746921:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3bec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897943 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.746963:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3bf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897943 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.747806:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938172.747816:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938172.747821:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87ce00, rc 0) 00000100:00100000:3.0:1784938172.747943:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10403:x1871643048711040:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 3890us (4415us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938172.747955:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:0.0:1784938172.757273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938172.757459:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048711424 00000100:00100000:1.0:1784938172.757473:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048711424 00000100:00100000:1.0:1784938172.757551:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1784938172.757575:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10403:x1871643048711424:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938172.758453:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10403:x1871643048711424:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 888us (1190us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1784938172.758470:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784938172.764950:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938172.769847:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048711552 00000100:00100000:1.0:1784938172.769869:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048711552 00000100:00100000:1.0:1784938172.769991:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784938172.770003:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10403:x1871643048711552:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:1.0:1784938172.770023:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1784938172.770056:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3b83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897927 expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.770099:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3bde lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89793c expref: 27 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.770130:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3a87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978e8 expref: 26 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938172.770141:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938172.770154:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938172.770270:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:10403:x1871643048711552:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 269us (5335us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938172.770278:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1784938172.772672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.772768:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048711680 00000100:00100000:2.0:1784938172.772781:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048711680 00000100:00100000:2.0:1784938172.772853:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1784938172.772863:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:10403:x1871643048711680:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:2.0:1784938172.773039:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.773058:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.773072:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938172.773919:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938172.774387:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1784938172.774450:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1784938172.774650:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:10403:x1871643048711680:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 1784us (1986us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938172.774662:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:0.0:1784938172.799774:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938172.799952:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048711808 00000100:00100000:2.0:1784938172.799965:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048711808 00000100:00100000:2.0:1784938172.800044:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:2.0:1784938172.800053:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:10405:x1871643048711808:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938172.800096:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938172.800122:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3c01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89794a expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.800204:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.801162:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938172.801181:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801289:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801301:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801310:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801639:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801649:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801662:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938172.801715:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784938172.801721:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938172.801748:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801762:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801772:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801780:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801792:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801799:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938172.801807:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801815:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801831:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938172.801834:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938172.801839:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801854:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801868:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801876:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801881:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801886:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938172.801889:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801903:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801909:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac3861e00) 00010000:00010000:3.0:1784938172.801912:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938172.801914:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801920:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801958:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3c01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 27 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801982:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 26 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938172.801995:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:3.0:1784938172.801997:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938172.802000:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87de00, rc 0) 00000100:00100000:3.0:1784938172.802281:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10405:x1871643048711808:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2226us (2518us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938172.802290:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000040:00080000:0.0:1784938173.233522:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938173.233535:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938173.233612:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1784938173.233621:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938173.233798:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065516800:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938173.233955:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad0c99540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938173.240722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.240811:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048711936 00000100:00100000:1.0:1784938173.240823:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048711936 00000100:00100000:1.0:1784938173.240917:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:1.0:1784938173.240929:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048711936:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1784938173.241048:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048711936:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 Request processed in 121us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.241067:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1784938173.241679:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065516800:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938173.242717:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.242812:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048712064 00000100:00100000:3.0:1784938173.242824:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048712064 00000100:00100000:3.0:1784938173.242903:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:3.0:1784938173.242915:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10416:x1871643048712064:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938173.242954:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938173.243143:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10416:x1871643048712064:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 230us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.243152:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:1.0:1784938173.248497:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.248604:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048712192 00000100:00100000:3.0:1784938173.248618:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048712192 00000100:00100000:3.0:1784938173.248705:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:3.0:1784938173.248719:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10416:x1871643048712192:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.248821:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248843:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248861:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248896:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248904:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248911:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248945:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248954:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.248961:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938173.249010:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1784938173.249015:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938173.249031:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249045:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249051:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249059:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249076:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938173.249081:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249089:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249106:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:3.0:1784938173.249109:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938173.249115:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249122:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c1d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249134:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249140:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249145:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249149:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ca00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938173.249151:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249154:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249167:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffffa05ac3861e00) 00010000:00010000:3.0:1784938173.249169:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938173.249171:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249175:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c24 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249187:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249190:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249194:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249197:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938173.249199:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249202:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249206:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:3.0:1784938173.249207:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938173.249208:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.249211:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.249569:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10416:x1871643048712192:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 851us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.249578:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1784938173.276242:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938173.276291:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048712448 00000100:00100000:2.0:1784938173.276304:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048712448 00000100:00100000:2.0:1784938173.276381:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1784938173.276394:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10416:x1871643048712448:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938173.276423:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938173.276452:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3c32 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897951 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276608:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276628:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276662:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938173.276679:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784938173.276824:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276832:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276839:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276844:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938173.276849:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276857:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276872:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:2.0:1784938173.276875:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938173.276880:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276899:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3c39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276946:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3c32 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897951 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276980:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:2.0:1784938173.276983:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938173.276988:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3c32 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897951 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.276998:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938173.277074:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048712448:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 683us (857us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1784938173.277082:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1784938173.289639:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.289812:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048712576 00000100:00100000:3.0:1784938173.289825:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048712576 00000100:00100000:3.0:1784938173.289935:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:3.0:1784938173.289948:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048712576:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1784938173.290011:0:5806:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1784938173.290155:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1688700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048712576:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 209us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.290164:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:2.0:1784938173.304121:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.304331:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048712832 00000100:00100000:3.0:1784938173.304344:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048712832 00000100:00100000:3.0:1784938173.304413:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:3.0:1784938173.304553:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048712832:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.304582:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938173.304586:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1784938173.304623:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3bf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897943 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.304642:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938173.304647:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938173.304664:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897958 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1784938173.305913:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1784938173.306297:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.306316:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.306330:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.306409:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897958 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.306429:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897958 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.306437:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861e00) 00010000:00010000:3.0:1784938173.306440:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938173.306444:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87ca00, rc 0) 00000100:00100000:3.0:1784938173.306609:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10416:x1871643048712832:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2184us (2501us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1784938173.306619:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00010000:00010000:0.0:1784938173.307048:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938173.311983:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.312925:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048713088 00000100:00100000:1.0:1784938173.312943:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048713088 00000100:00100000:1.0:1784938173.313036:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:1.0:1784938173.313049:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10416:x1871643048713088:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938173.313133:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938173.313168:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec3c4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897958 expref: 28 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.313210:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861e00) 00010000:00010000:1.0:1784938173.313260:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938173.313292:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.313308:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.313321:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.316651:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.316676:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.316690:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317043:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317050:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317056:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317061:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938173.317066:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317079:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317090:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938173.317093:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938173.317097:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317103:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3c5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317113:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317118:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317123:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317128:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938173.317130:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317135:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317140:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x90e0ae45 (ffffa05ac7d1db00) 00010000:00010000:1.0:1784938173.317142:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938173.317146:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.317159:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3c63 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x90e0ae45 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.318376:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1688000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048713088:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 5320us (6400us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938173.318391:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:2.0:1784938173.323424:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.324629:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048713216 00000100:00100000:3.0:1784938173.324646:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048713216 00000100:00100000:3.0:1784938173.324728:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1784938173.324820:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10416:x1871643048713216:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.324849:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938173.324896:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89795f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.324944:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.324962:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.324976:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.325436:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.325456:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.325466:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:3.0:1784938173.325469:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938173.325474:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87ce00, rc 0) 00000100:00100000:3.0:1784938173.325928:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10416:x1871643048713216:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1111us (2512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.325938:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:2.0:1784938173.336478:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.336663:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048713472 00000100:00100000:3.0:1784938173.336676:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048713472 00000100:00100000:3.0:1784938173.336768:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:3.0:1784938173.336780:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:10416:x1871643048713472:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.336930:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.336961:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.336976:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938173.337522:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1784938173.337536:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 382280319945ns, next at 383280316372ns, rc = 0 00000004:00010000:3.0:1784938173.337649:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cb8a0134 reply state 000000005bba156c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.337662:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938173.337798:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10416:x1871643048713472:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1019us (1332us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1784938173.337807:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:2.0:1784938173.345672:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:1.0:1784938173.345731:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.345749:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.345756:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.345763:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938173.345768:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.345775:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.345792:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:1.0:1784938173.345795:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938173.345800:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.345806:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3c78 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.346030:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048713600 00000100:00100000:3.0:1784938173.346045:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048713600 00000100:00100000:3.0:1784938173.346121:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:3.0:1784938173.346134:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:10416:x1871643048713600:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.346168:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938173.346194:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897966 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.346298:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.346316:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.346355:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:3.0:1784938173.346359:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938173.346363:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c200, rc 0) 00000100:00100000:3.0:1784938173.346438:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1688a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10416:x1871643048713600:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 306us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.346446:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:1.0:1784938173.356185:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938173.356294:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048713728 00000100:00100000:0.0:1784938173.356315:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048713728 00000100:00100000:0.0:1784938173.356381:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1784938173.356393:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1871643048713728:12345-192.168.201.58@tcp:8:lhsmtool_posix.0 00010000:00080000:0.0:1784938173.356441:0:6605:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp t0 exp 0000000000000000 cur 382 last 0 00000020:00000080:0.0:1784938173.356480:0:6605:0:(genops.c:1406:class_connect()) connect: client 8bbc0047-63c1-4cac-b5e6-ede401808e2e, cookie 0xea86628a8aec3c86 00002000:00100000:0.0:1784938173.356508:0:6605:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8bbc0047-63c1-4cac-b5e6-ede401808e2e/ffffa05ad09b7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1784938173.356540:0:6605:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1784938173.356961:0:6605:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938173.357288:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ad09b6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938173.357392:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2354:x1871643048713728:12345-192.168.201.58@tcp:8:lhsmtool_posix.0 Request processed in 999us (1216us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.357403:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:1.0:1784938173.362312:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.365045:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048713856 00000100:00100000:3.0:1784938173.365069:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048713856 00000100:00100000:3.0:1784938173.365178:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1784938173.365191:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:0:x1871643048713856:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1784938173.369064:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938173.481403:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:0:x1871643048713856:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 116202us (119089us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1784938173.481420:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000001:00100000:3.0:1784938173.481462:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000001:00080000:3.0:1784938173.481479:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:0.0:1784938173.491638:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.491808:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048714112 00000100:00100000:1.0:1784938173.492790:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048714112 00000100:00100000:1.0:1784938173.492988:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938173.493000:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10416:x1871643048714112:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784938173.493569:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10416:x1871643048714112:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 569us (1941us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1784938173.493581:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784938173.507348:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938173.513013:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048714368 00000100:00100000:2.0:1784938173.513039:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048714368 00000100:00100000:1.0:1784938173.513195:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:1.0:1784938173.513271:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10416:x1871643048714368:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784938173.513485:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10416:x1871643048714368:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 274us (6151us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.513495:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1784938173.527339:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938173.528422:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048714496 00000100:00100000:0.0:1784938173.528452:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048714496 00000100:00100000:0.0:1784938173.528533:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1784938173.528543:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10416:x1871643048714496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938173.528577:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938173.528606:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3c8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89796d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.528715:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.528734:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.528749:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938173.528801:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938173.528831:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.528866:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89796d expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.528898:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89796d expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.528909:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:0.0:1784938173.528913:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1784938173.528917:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031400, rc 0) 00000100:00100000:0.0:1784938173.529010:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1688380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10416:x1871643048714496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 468us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.529025:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1784938173.538791:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.539431:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048714624 00000100:00100000:1.0:1784938173.539447:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048714624 00000100:00100000:1.0:1784938173.539512:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1784938173.539523:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048714624:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938173.539544:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938173.539569:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897974 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938173.539597:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63febe, blocks: 0x1 00010000:00010000:1.0:1784938173.539617:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=382s v=(0 0) 00010000:00010000:1.0:1784938173.539631:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938173.539641:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 6 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.539664:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 6 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.539680:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991e00, rc 0) 00000100:00100000:1.0:1784938173.539759:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048714624:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 238us (993us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.539768:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1784938173.551790:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.552160:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048714880 00000100:00100000:3.0:1784938173.552171:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048714880 00000100:00100000:3.0:1784938173.552381:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:3.0:1784938173.552392:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10416:x1871643048714880:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938173.552513:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10416:x1871643048714880:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 123us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.552522:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:3.0:1784938173.556770:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.556904:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715008 00000100:00100000:1.0:1784938173.556914:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715008 00000100:00100000:1.0:1784938173.556984:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:1.0:1784938173.556995:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:10416:x1871643048715008:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938173.557018:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938173.557040:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89797b expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.557077:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.557088:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938173.557093:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938173.557099:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.557147:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.557162:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.557178:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff818a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1871643065516928:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938173.557317:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20976c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.561762:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff818a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1871643065516928:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938173.561804:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.561839:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991800, rc 0) 00000100:00100000:1.0:1784938173.561918:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:10416:x1871643048715008:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 4925us (5157us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.561928:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:2.0:1784938173.572868:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.573741:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715136 00000100:00100000:3.0:1784938173.573758:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715136 00010000:00010000:3.0:1784938173.573818:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.573926:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1784938173.573937:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048715136:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938173.573954:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938173.573990:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.574004:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.574036:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec3c9b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897974 expref: 7 pid: 6604 timeout: 482 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.574058:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938173.574064:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938173.574074:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.574085:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.574129:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.574161:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff970700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871643065517056:192.168.201.58@tcp:105: 00000100:00100000:3.0:1784938173.574442:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac823e6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.590770:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff970700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871643065517056:192.168.201.58@tcp:105: 00010000:00010000:1.0:1784938173.590809:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938173.590930:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048715136:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 16993us (18205us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.590943:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1784938173.592800:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938173.592939:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715264 00000100:00100000:0.0:1784938173.592952:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715264 00002000:00100000:0.0:1784938173.593025:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa05ae1689c00 x1871643048715264/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:404/0 lens 504/0 e 0 to 0 dl 1784938184 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938173.593039:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05ae1689c00 with x1871643048715264 ext(0->8) 00002000:00010000:0.0:1784938173.593045:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05ae1689c00 00000100:00100000:0.0:1784938173.593089:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784938173.593100:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048715264:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784938173.595727:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048715264:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 2619us (2930us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1784938173.595744:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00002000:00100000:0.0:1784938173.595760:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffffa05ae1689c00 x1871643048715264/t4294967302(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:404/0 lens 504/448 e 0 to 0 dl 1784938184 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938173.595770:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05ae1689c00 with x1871643048715264 ext(0->8) 00002000:00010000:0.0:1784938173.595778:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05ae1689c00 00000100:00100000:2.0:1784938173.608300:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.610106:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715392 00000100:00100000:3.0:1784938173.610121:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715392 00000100:00100000:3.0:1784938173.610200:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1784938173.610211:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10416:x1871643048715392:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1784938173.723949:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967340 is committed 00000020:00080000:2.0:1784938173.723982:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1784938173.724005:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1784938173.724042:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1784938173.724155:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1784938173.724177:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1784938173.724934:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065517184:192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00100000:3.0:1784938173.725154:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10416:x1871643048715392:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 114942us (116862us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938173.725174:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:0.0:1784938173.726092:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938173.726121:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065517184 00000100:00100000:0.0:1784938173.726129:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065517184 00000100:00100000:0.0:1784938173.726201:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 29 00000100:00100000:0.0:1784938173.726211:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065517184:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00080000:1.0:1784938173.727285:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1784938173.727584:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1784938173.727588:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784938174 00002000:00010000:0.0:1784938173.727601:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1784938173.727603:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784938174 -> 1784938174 00002000:00010000:0.0:1784938173.727606:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1784938173.727806:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1871643065517184:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 Request processed in 1525us (1645us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784938173.727817:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 29 00000100:00100000:0.0:1784938173.730233:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.731037:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715520 00000100:00100000:3.0:1784938173.731050:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715520 00000100:00100000:3.0:1784938173.731151:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:3.0:1784938173.731173:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2358:x1871643048715520:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000004:00080000:3.0:1784938173.732163:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05ae168b100/2, rc 0, transno 4294967303 00000100:00100000:3.0:1784938173.732187:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065517184:192.168.201.158@tcp:2:osp-syn-1-0.0 00000001:00080000:3.0:1784938173.834162:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1784938173.834180:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1784938173.834395:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048715520:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 103229us (104184us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.834407:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784938173.839936:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.840023:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715776 00000100:00100000:3.0:1784938173.840033:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715776 00000100:00100000:3.0:1784938173.840123:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784938173.840133:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10416:x1871643048715776:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.840188:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938173.840230:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89796d expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.840254:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:3.0:1784938173.840259:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938173.840295:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.840309:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.840318:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938173.840655:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bfc71c05 reply state 000000004c812ef5 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.840665:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938173.840753:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10416:x1871643048715776:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 622us (826us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1784938173.840760:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784938173.845028:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1784938173.845069:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.845083:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.845091:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.845097:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938173.845101:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.845119:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.845136:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:3.0:1784938173.845139:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938173.845144:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.845150:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3ca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.845183:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048715904 00000100:00100000:3.0:1784938173.845193:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048715904 00000100:00100000:3.0:1784938173.845262:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1784938173.845272:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048715904:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1784938173.845549:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1784938173.845553:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1784938174 -> 1784938173 00002000:00010000:3.0:1784938173.845556:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784938171 00002000:00010000:3.0:1784938173.845560:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784938174 -> 1784938173 00002000:00010000:3.0:1784938173.845562:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784938173.845620:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048715904:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 349us (603us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1784938173.845628:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1784938173.849549:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.852097:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048716160 00000100:00100000:1.0:1784938173.852112:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048716160 00000100:00100000:1.0:1784938173.852181:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1784938173.852191:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10416:x1871643048716160:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1784938173.852277:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.852294:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.852304:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.852338:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.852351:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 13 pid: 5804 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.852366:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff818a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065517312:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938173.852466:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dad80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.863140:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.863270:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff818a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065517312:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938173.863300:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.863403:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048716288 00000100:00100000:0.0:1784938173.863411:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048716288 00010000:00010000:0.0:1784938173.863510:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 14 pid: 5804 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.863550:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:0.0:1784938173.863570:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2356:x1871643048716288:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938173.863587:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938173.863595:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 14 pid: 5804 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.863609:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 14 pid: 5804 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.863634:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89795f expref: 14 pid: 5804 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.863660:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:0.0:1784938173.863665:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.863674:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.863683:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.863712:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938173.863762:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2356:x1871643048716288:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 202us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.863769:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00010000:00010000:1.0:1784938173.864059:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864068:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864108:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864115:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864121:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864127:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938173.864132:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864140:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864150:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:1.0:1784938173.864154:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1784938173.864158:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.864169:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3cb0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938173.864250:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:10416:x1871643048716160:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 12060us (14710us total) trans 0 rc -22/-22 00000100:00100000:1.0:1784938173.864260:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1784938173.870782:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.870820:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048716416 00000100:00100000:3.0:1784938173.870830:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048716416 00000100:00100000:3.0:1784938173.870902:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784938173.870914:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048716416:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1784938173.870966:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.870987:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.870997:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938173.871002:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938173.871007:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.871044:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.871060:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 7 pid: 6602 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.871075:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff971880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1871643065517440:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938173.871158:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac823e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.875429:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff971880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6602:1871643065517440:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938173.875521:0:6602:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938173.877556:0:11865:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938173.877569:0:11865:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938173.877616:0:11865:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784938173.877623:0:11865:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938173.882680:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938173.882715:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048716544 00000100:00100000:0.0:1784938173.882724:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048716544 00010000:00010000:0.0:1784938173.882761:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 8 pid: 6602 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.882809:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784938173.882818:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048716544:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938173.882834:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938173.882856:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 8 pid: 6602 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.882871:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 8 pid: 6602 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.882914:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8c7f12/0xea86628a8aec3ca2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89797b expref: 8 pid: 6602 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.882930:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938173.882934:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938173.882940:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.882950:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.882978:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938173.883022:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048716544:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 205us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.883029:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00010000:00010000:0.0:1784938173.883116:0:6602:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883126:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883149:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883157:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883172:0:6602:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883179:0:6602:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87da00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938173.883183:0:6602:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883192:0:6602:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883203:0:6602:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.883211:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000362cc93a/0xea86628a8aec3cb7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.883306:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048716416:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 12395us (12534us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.883315:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:0.0:1784938173.898631:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938173.898726:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048716800 00000100:00100000:2.0:1784938173.898736:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048716800 00000100:00100000:2.0:1784938173.898804:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:2.0:1784938173.898815:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:10416:x1871643048716800:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1784938173.898908:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.898926:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.898939:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.899829:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.899846:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.899854:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.900716:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.900735:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 13 pid: 5805 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938173.900771:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065517568:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938173.903121:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05acb17a780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.906026:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938173.906054:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065517568:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938173.906062:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048716928 00000100:00100000:0.0:1784938173.906070:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048716928 00010000:00010000:1.0:1784938173.906084:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906110:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 14 pid: 5805 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.906167:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:0.0:1784938173.906178:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2356:x1871643048716928:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938173.906193:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938173.906201:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 14 pid: 5805 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906232:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 14 pid: 5805 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906269:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3c7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897966 expref: 14 pid: 5805 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906284:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:0.0:1784938173.906290:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906310:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906318:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.906344:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938173.906363:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938173.906371:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.906395:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2356:x1871643048716928:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 219us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938173.906405:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000001:00080000:1.0:1784938173.907067:0:7211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1784938173.907732:0:7211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1784938173.907777:0:7211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1784938173.908760:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff819c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1871643065517696:192.168.201.158@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938173.908859:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b020ee300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.909081:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938173.909165:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065517696 00000100:00100000:1.0:1784938173.909171:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065517696 00000100:00100000:1.0:1784938173.909230:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938173.909237:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7211:x1871643065517696:12345-192.168.201.158@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938173.909309:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7211:x1871643065517696:12345-192.168.201.158@tcp:1000:mdt00_003.0 Request processed in 71us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938173.909315:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:2.0:1784938173.909585:0:7211:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1784938173.909666:0:7211:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05ae168b100, transno 4294967303 00000100:00100000:2.0:1784938173.909683:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff819c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1871643065517696:192.168.201.158@tcp:1000:mdt00_003.0 00000001:00080000:2.0:1784938173.910277:0:7211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1784938173.910339:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1871643065517824:192.168.201.158@tcp:1000:mdt00_003.0 00000100:00100000:2.0:1784938173.910378:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aee2dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938173.910772:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938173.910922:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065517824 00000100:00100000:1.0:1784938173.910928:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065517824 00000100:00100000:1.0:1784938173.910982:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:1.0:1784938173.910991:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7211:x1871643065517824:12345-192.168.201.158@tcp:1000:mdt00_003.0 00000100:00100000:1.0:1784938173.911186:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:7211:x1871643065517824:12345-192.168.201.158@tcp:1000:mdt00_003.0 Request processed in 195us (414us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1784938173.911195:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938173.911571:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7211:1871643065517824:192.168.201.158@tcp:1000:mdt00_003.0 00010000:00010000:0.0:1784938173.911611:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911621:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911629:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911635:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938173.911640:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911648:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911666:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861500) 00010000:00010000:0.0:1784938173.911670:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938173.911675:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911682:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3cc5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911718:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911725:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911742:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911747:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938173.911751:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911757:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911767:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:0.0:1784938173.911769:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938173.911772:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911778:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3bfa lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911826:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911840:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 16 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911848:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911894:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 16 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.911922:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 16 pid: 7211 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.911935:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065517952:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938173.913313:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8b42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938173.922381:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.922431:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717056 00000100:00100000:3.0:1784938173.922446:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717056 00010000:00010000:3.0:1784938173.922748:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 17 pid: 7211 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.922797:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:3.0:1784938173.922810:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:2357:x1871643048717056:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938173.922827:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938173.922835:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 17 pid: 7211 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.922851:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 17 pid: 7211 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938173.922881:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065517952:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938173.922896:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89794a expref: 17 pid: 7211 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.922910:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.922914:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:3.0:1784938173.922924:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.922935:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.922943:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.927953:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938173.928094:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928108:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928123:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928129:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928138:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.928142:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:2357:x1871643048717056:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 5329us (5765us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938173.928147:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938173.928152:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928162:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928185:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:2.0:1784938173.928188:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938173.928193:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928200:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3ccc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928211:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938173.928243:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00010000:00010000:2.0:1784938173.928243:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928253:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928504:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938173.928508:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928515:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928525:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ad886b200) 00010000:00010000:2.0:1784938173.928527:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938173.928530:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938173.928536:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3cbe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938173.928892:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10416:x1871643048716800:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 30079us (30269us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1784938173.928902:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000020:00080000:2.0:1784938173.928906:0:7211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784938173.928926:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938173.928932:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938173.928984:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784938173.928993:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938173.933388:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938173.933455:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717312 00000100:00100000:3.0:1784938173.933464:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717312 00000100:00100000:3.0:1784938173.933537:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784938173.933545:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10416:x1871643048717312:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784938173.936263:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784938173.936930:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1784938173.937155:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.937378:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.937392:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.937402:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.937408:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.937415:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938173.937440:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938173.937505:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938173.937513:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.937522:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87de00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938173.937526:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.937535:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.937548:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffffa05ac3861600) 00010000:00010000:0.0:1784938173.937551:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784938173.937563:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.937570:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938173.937598:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938173.937600:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938173.937601:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938173.937694:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:10416:x1871643048717312:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 4143us (4309us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1784938173.937706:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000020:00080000:3.0:1784938173.937713:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784938174.006287:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065518208:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.006451:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065518464:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938174.006512:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065518080:0@lo:400:kworker.0 00000100:00100000:0.0:1784938174.006611:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938174.006619:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065518336:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.009139:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938174.009471:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938174.009500:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065518208 00000100:00100000:3.0:1784938174.009509:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065518208 00000100:00100000:3.0:1784938174.009560:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 138 00000100:00100000:3.0:1784938174.009571:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065518208:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.009639:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065518208:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 70us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938174.009647:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 138 00000100:00100000:3.0:1784938174.009672:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065518464 00000100:00100000:3.0:1784938174.009675:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065518464 00000100:00100000:3.0:1784938174.009707:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00100000:3.0:1784938174.009714:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065518464:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.009740:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065518464:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938174.009747:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00100000:2.0:1784938174.010295:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938174.010335:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065518592:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938174.010471:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065518080 00000100:00100000:2.0:1784938174.010476:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065518080 00000100:00100000:2.0:1784938174.010504:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784938174.010510:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065518080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938174.010551:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065518080:12345-0@lo:400:kworker.0 Request processed in 41us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938174.010558:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:2.0:1784938174.010602:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065518080:0@lo:400:kworker.0 00000100:00100000:3.0:1784938174.011538:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938174.011559:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00080000:3.0:1784938174.011578:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938174.011619:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065518464:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.011645:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065518592 00000100:00100000:3.0:1784938174.011656:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065518592 00000100:00100000:3.0:1784938174.011690:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065518336 00000100:00100000:3.0:1784938174.011693:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065518336 00000100:00100000:3.0:1784938174.011715:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 139 00000100:00100000:3.0:1784938174.011723:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065518592:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.011770:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065518592:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 47us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938174.012197:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065518208:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938174.012485:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065518592:192.168.201.158@tcp:400:kworker.0 00000100:00080000:1.0:1784938174.012931:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938174.012954:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 140 00000100:00100000:1.0:1784938174.012966:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065518336:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.013174:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 139 00000100:00100000:1.0:1784938174.013517:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065518336:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 552us (1954us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938174.013525:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 140 00000100:00100000:3.0:1784938174.014149:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065518336:192.168.201.158@tcp:400:kworker.0 00010000:00010000:0.0:1784938174.324719:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938174.390686:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938174.390733:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938174.390781:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938174.390817:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938174.390849:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938174.390888:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717952 00000100:00100000:3.0:1784938174.390899:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717952 00000100:00100000:3.0:1784938174.390976:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717568 00000100:00100000:3.0:1784938174.390980:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717568 00000100:00100000:3.0:1784938174.391005:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:3.0:1784938174.391015:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048717952:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.391098:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2357:x1871643048717952:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 84us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938174.391107:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:3.0:1784938174.391130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:3.0:1784938174.391136:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:2357:x1871643048717568:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938174.391167:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:2357:x1871643048717568:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 31us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938174.391187:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00080000:1.0:1784938174.391803:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938174.391954:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717440 00000100:00100000:2.0:1784938174.391962:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717440 00000100:00100000:2.0:1784938174.392005:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 288 00000100:00100000:2.0:1784938174.392013:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048717440:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938174.392072:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048717440:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 59us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938174.392079:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 288 00000100:00100000:0.0:1784938174.392527:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717696 00000100:00100000:0.0:1784938174.392534:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717696 00000100:00100000:0.0:1784938174.392588:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048717824 00000100:00100000:0.0:1784938174.392592:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048717824 00000100:00100000:0.0:1784938174.392617:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1784938174.392625:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2357:x1871643048717696:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938174.392664:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2357:x1871643048717696:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 40us (1930us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938174.392671:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1784938174.392685:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:0.0:1784938174.392691:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048717824:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938174.392716:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048717824:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938174.392722:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00080000:1.0:1784938174.392968:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938174.514756:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065518720:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938174.516141:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938174.516299:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065518720 00000100:00100000:1.0:1784938174.516309:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065518720 00000100:00100000:1.0:1784938174.516419:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 63 00000100:00100000:1.0:1784938174.516429:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1871643065518720:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938174.516454:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784938174.516576:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1871643065518720:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 147us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938174.516584:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 63 00000100:00100000:0.0:1784938174.519972:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff819f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065518720:192.168.201.158@tcp:13:osp-pre-1-0.0 00000040:00080000:3.0:1784938174.963650:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938174.963660:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938174.963714:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1784938174.963722:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1784938175.347608:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1784938175.688681:0:11917:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938175.688692:0:11917:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938175.688746:0:11917:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1784938175.688752:0:11917:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938175.792086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938175.792170:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048718208 00000100:00100000:3.0:1784938175.792179:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048718208 00000100:00100000:3.0:1784938175.792458:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1784938175.792470:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:10435:x1871643048718208:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938175.792493:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938175.792515:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3cda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897982 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.792926:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ce1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.792941:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.792951:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938175.792963:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1784938175.794561:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3cda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897982 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.794654:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897982 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.794671:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938175.794674:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938175.794678:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d600, rc 0) 00000100:00100000:3.0:1784938175.794800:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10435:x1871643048718208:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2332us (2723us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1784938175.794810:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1784938175.800001:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938175.800080:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048718336 00000100:00100000:0.0:1784938175.800091:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048718336 00000100:00100000:0.0:1784938175.800161:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:0.0:1784938175.800171:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10435:x1871643048718336:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:0.0:1784938175.800508:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800526:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800537:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800555:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800562:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800643:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800981:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800990:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.800998:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938175.801039:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801060:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801067:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801075:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801081:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938175.801086:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801093:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801106:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938175.801109:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938175.801114:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801120:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3cef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801142:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801149:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801155:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801166:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938175.801169:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801174:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801182:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac30f8500) 00010000:00010000:0.0:1784938175.801184:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938175.801187:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801193:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3cf6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801208:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801489:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801497:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801502:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938175.801506:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801513:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801534:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938175.801537:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938175.801540:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.801546:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3cfd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938175.801834:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10435:x1871643048718336:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1661us (1839us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938175.801855:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1784938175.850739:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938175.851143:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048718592 00000100:00100000:0.0:1784938175.851158:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048718592 00000100:00100000:0.0:1784938175.851256:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:0.0:1784938175.851265:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:10438:x1871643048718592:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938175.851291:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938175.851315:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3d04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897989 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851405:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851419:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851429:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851440:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851456:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851461:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851790:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851800:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851807:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938175.851817:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1784938175.851950:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851957:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851964:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851971:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938175.851976:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.851984:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852009:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938175.852013:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938175.852019:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852026:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852041:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852048:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852053:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852058:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938175.852062:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852068:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852075:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938175.852078:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938175.852081:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852086:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852141:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0030000/0xea86628a8aec3d04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 22 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852153:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.852159:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938175.852160:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938175.852162:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031400, rc 0) 00000100:00100000:0.0:1784938175.852262:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10438:x1871643048718592:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 998us (1534us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1784938175.852268:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:0.0:1784938175.864082:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938175.864496:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048718720 00000100:00100000:1.0:1784938175.864522:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048718720 00000100:00100000:1.0:1784938175.864606:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:1.0:1784938175.864617:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10438:x1871643048718720:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:1.0:1784938175.864707:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864728:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864743:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864777:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864785:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864792:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864798:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938175.864803:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864812:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864826:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:1.0:1784938175.864847:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938175.864853:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.864872:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938175.865563:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10438:x1871643048718720:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 887us (1436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938175.865575:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1784938175.872237:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938175.872299:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048718976 00000100:00100000:3.0:1784938175.872554:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048718976 00000100:00100000:3.0:1784938175.872714:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784938175.872729:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10438:x1871643048718976:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784938175.874087:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:10438:x1871643048718976:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 1272us (1798us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1784938175.874098:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784938175.917358:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938175.917407:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048719232 00000100:00100000:3.0:1784938175.917419:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048719232 00000100:00100000:3.0:1784938175.917487:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:3.0:1784938175.917499:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:9960:x1871643048719232:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938175.917547:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938175.917574:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3d2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897990 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.917732:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.917766:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.917775:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.917848:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.917865:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 23 pid: 5804 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938175.917882:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff883100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065518848:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938175.918186:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac823e6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938175.934100:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff883100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065518848:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938175.934143:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938175.935181:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938175.936047:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048719360 00000100:00100000:3.0:1784938175.936064:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048719360 00010000:00010000:3.0:1784938175.936130:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 24 pid: 5804 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938175.936233:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1784938175.936247:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:2356:x1871643048719360:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938175.936268:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938175.936297:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 24 pid: 5804 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936311:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 24 pid: 5804 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936337:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897989 expref: 24 pid: 5804 timeout: 484 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936355:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:3.0:1784938175.936362:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936373:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936381:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936411:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938175.936483:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:2356:x1871643048719360:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 239us (1311us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938175.936496:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00010000:00010000:3.0:1784938175.936743:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.936753:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938175.936780:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1784938175.937846:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 24 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.937892:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.937903:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:3.0:1784938175.937907:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938175.937911:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c800, rc 0) 00000100:00100000:3.0:1784938175.937979:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:9960:x1871643048719232:12345-192.168.201.58@tcp:101:bash.0 Request processed in 20481us (20634us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1784938175.937989:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:3.0:1784938175.941391:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938175.944370:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048719616 00000100:00100000:1.0:1784938175.944386:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048719616 00000100:00100000:1.0:1784938175.944460:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:1.0:1784938175.944472:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:9960:x1871643048719616:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:1.0:1784938175.944768:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.944785:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.944797:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938175.944862:0:7211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1784938175.944887:0:7211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a77a557 reply state 00000000193458b8 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938175.944897:0:7211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784938175.944943:0:7211:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1784938175.945055:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:9960:x1871643048719616:12345-192.168.201.58@tcp:36:bash.0 Request processed in 585us (3678us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1784938175.945063:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 89 00000020:00080000:1.0:1784938175.945079:0:7211:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:1.0:1784938175.952277:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.952295:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.952303:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.952310:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938175.952315:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.952323:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.952340:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:1.0:1784938175.952343:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938175.952349:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938175.952581:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938175.953143:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048719744 00000100:00100000:3.0:1784938175.953158:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048719744 00000100:00100000:3.0:1784938175.953260:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:3.0:1784938175.953273:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:9960:x1871643048719744:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938175.953307:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938175.953337:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3d4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897997 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938175.953340:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3d43 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.953426:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3d4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897997 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.953443:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3d4a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897997 expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938175.953467:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:3.0:1784938175.953485:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938175.953489:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c400, rc 0) 00000100:00100000:3.0:1784938175.953580:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:9960:x1871643048719744:12345-192.168.201.58@tcp:101:bash.0 Request processed in 308us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938175.959145:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:1.0:1784938175.959539:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938175.959649:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048719872 00000100:00100000:0.0:1784938175.959664:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048719872 00000100:00080000:1.0:1784938175.959726:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938175.959759:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1784938175.959774:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afc8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:9960:x1871643048719872:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938175.959799:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938175.959829:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a89799e expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938175.959879:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a63febd, atime: 0x6a63febb, ctime: 0x6a63febd, blocks: 0xb 00010000:00010000:0.0:1784938175.959918:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=384s v=(0 0) 00010000:00010000:0.0:1784938175.959924:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938175.959934:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.959978:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938175.959995:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938175.960083:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afc8d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:9960:x1871643048719872:12345-192.168.201.58@tcp:101:bash.0 Request processed in 313us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938175.960091:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:2.0:1784938175.962675:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938175.963413:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048720000 00000100:00100000:1.0:1784938175.963431:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048720000 00002000:00010000:1.0:1784938175.963492:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:1.0:1784938175.963498:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05ae168a300 with x1871643048720000 ext(0->18446744073709551615) 00002000:00010000:1.0:1784938175.963511:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05ae168a300. 00000100:00100000:0.0:1784938175.963619:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784938175.963640:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048720000:12345-192.168.201.58@tcp:10:bash.0 00002000:00010000:0.0:1784938175.964098:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1784938175.964103:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1784938173 -> 1784938176 00002000:00010000:0.0:1784938175.964106:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1784938171 -> 1784938171 00002000:00010000:0.0:1784938175.964108:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1784938173 -> 1784938176 00002000:00010000:0.0:1784938175.964111:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1784938175.964194:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048720000:12345-192.168.201.58@tcp:10:bash.0 Request processed in 562us (1530us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1784938175.964204:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00010000:0.0:1784938175.964210:0:6609:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1784938175.964266:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05ae168a300 with x1871643048720000 ext(0->18446744073709551615) 00002000:00010000:0.0:1784938175.964276:0:6609:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05ae168a300. 00000100:00100000:0.0:1784938176.052985:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.053192:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048720128 00000100:00100000:0.0:1784938176.053204:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048720128 00000100:00100000:0.0:1784938176.053296:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:0.0:1784938176.053313:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10452:x1871643048720128:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:0.0:1784938176.053409:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053425:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053436:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053447:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053452:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053455:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053725:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053732:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053736:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938176.053785:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053799:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053808:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053814:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053818:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.053821:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053827:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053849:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938176.053852:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.053856:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053860:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3d58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053871:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053874:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053878:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053881:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.053887:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053891:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053895:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac30f8700) 00010000:00010000:0.0:1784938176.053897:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.053898:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053902:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053913:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053917:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053920:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053923:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.053924:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053927:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053931:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938176.053932:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.053938:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.053941:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.054013:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10452:x1871643048720128:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 701us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.054019:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00080000:0.0:1784938176.054152:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938176.095667:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.095773:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048720384 00000100:00100000:2.0:1784938176.095790:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048720384 00000100:00100000:2.0:1784938176.095885:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:2.0:1784938176.095898:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:10455:x1871643048720384:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938176.095933:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938176.095963:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3d6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979a5 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096048:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096063:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096076:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096086:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096091:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096095:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096484:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096493:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096498:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938176.096515:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1784938176.096608:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096614:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096619:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096623:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.096627:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096632:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096642:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938176.096644:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938176.096647:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096659:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3d74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096669:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096672:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096676:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096679:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.096681:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096684:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096688:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886be00) 00010000:00010000:2.0:1784938176.096689:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938176.096691:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096694:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096730:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3d6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979a5 expref: 30 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096739:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979a5 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.096748:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:2.0:1784938176.096749:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784938176.096751:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938176.096825:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:10455:x1871643048720384:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 930us (1170us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1784938176.096833:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:2.0:1784938176.100697:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.100778:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048720512 00000100:00100000:3.0:1784938176.100792:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048720512 00000100:00100000:3.0:1784938176.100875:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:3.0:1784938176.100886:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:10455:x1871643048720512:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784938176.100985:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.101006:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.101015:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.101060:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 29 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.101076:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 29 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.101093:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065518976:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938176.101201:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aded6fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938176.105034:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.105340:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048720768 00000100:00100000:1.0:1784938176.105353:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048720768 00000100:00100000:1.0:1784938176.105418:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784938176.105429:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:9924:x1871643048720768:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784938176.105539:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff881f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065518976:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938176.105569:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.108116:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:9924:x1871643048720768:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 2677us (3086us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1784938176.108131:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784938176.111659:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.111794:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048720896 00000100:00100000:0.0:1784938176.111808:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048720896 00010000:00010000:0.0:1784938176.111868:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 31 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.111911:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784938176.111928:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:2356:x1871643048720896:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938176.111946:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938176.111956:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 31 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.111969:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 31 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.112006:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3d35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897990 expref: 31 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.112024:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938176.112029:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.112041:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.112050:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.112088:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938176.112150:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:2356:x1871643048720896:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 229us (506us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938176.112335:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112345:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112389:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112397:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112403:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112409:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.112415:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112424:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112447:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:2.0:1784938176.112449:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938176.112453:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.112460:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.112524:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1688e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10455:x1871643048720512:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 11640us (11842us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.112535:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:0.0:1784938176.112753:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:1.0:1784938176.116459:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.116507:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048721152 00000100:00100000:1.0:1784938176.116520:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048721152 00000100:00100000:1.0:1784938176.116589:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1784938176.116600:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:10455:x1871643048721152:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938176.116901:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10455:x1871643048721152:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 301us (455us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1784938176.116910:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000001:00080000:3.0:1784938176.121082:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:3.0:1784938176.121123:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1784938176.209543:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.209729:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048721408 00000100:00100000:0.0:1784938176.209751:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048721408 00000100:00100000:0.0:1784938176.209896:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:0.0:1784938176.209908:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:10466:x1871643048721408:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784938176.209951:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.209984:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3d97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979ac expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.210080:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.210119:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.210132:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.210152:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.210159:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.210166:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211511:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3dac lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211532:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211543:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3dac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.211556:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1784938176.211690:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211699:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211707:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211722:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.211728:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211736:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211762:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938176.211765:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.211771:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211778:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3d9e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211792:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211798:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211804:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211809:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.211812:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211817:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211854:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac30f8700) 00010000:00010000:0.0:1784938176.211857:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.211860:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211866:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3da5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211938:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3d97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ac expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211955:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3dac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ac expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.211981:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938176.211984:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938176.211987:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a000, rc 0) 00000100:00100000:0.0:1784938176.213369:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10466:x1871643048721408:12345-192.168.201.58@tcp:101:cat.0 Request processed in 3451us (3831us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1784938176.213384:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1784938176.227363:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.227546:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048721664 00000100:00100000:1.0:1784938176.227561:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048721664 00000100:00100000:1.0:1784938176.227638:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1784938176.227650:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10466:x1871643048721664:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:1.0:1784938176.228185:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10466:x1871643048721664:12345-192.168.201.58@tcp:35:cat.0 Request processed in 534us (834us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1784938176.228196:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1784938176.265336:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.265622:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048721920 00000100:00100000:3.0:1784938176.265636:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048721920 00000100:00100000:3.0:1784938176.265716:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:3.0:1784938176.265729:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10467:x1871643048721920:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:3.0:1784938176.265841:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1784938176.265878:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3dac lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ac expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.265907:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3d82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979a5 expref: 32 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.265933:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3d4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897997 expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.265945:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:3.0:1784938176.265959:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938176.265987:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266003:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266016:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266033:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266059:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266067:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266729:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266741:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.266749:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938176.267593:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1784938176.267606:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 385210389666ns, next at 386210385930ns, rc = 0 00010000:00010000:3.0:1784938176.267683:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267695:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267705:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267713:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267719:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267737:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267768:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938176.267801:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267808:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267815:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267821:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938176.267827:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267920:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267935:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac3861400) 00010000:00010000:3.0:1784938176.267939:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1784938176.267944:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267951:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3dc8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267973:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267980:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267993:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.267998:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938176.268002:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.268009:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.268018:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938176.268021:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938176.268024:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.268030:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3dba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938176.268042:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a2edc3a0 reply state 000000000038ac18 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.268052:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938176.268175:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:10467:x1871643048721920:12345-192.168.201.58@tcp:36:rm.0 Request processed in 2445us (2852us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1784938176.268185:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00010000:00010000:0.0:1784938176.268868:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938176.268879:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.268887:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938176.268890:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.268925:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.268938:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffffa05ac3861400) 00010000:00010000:0.0:1784938176.268940:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784938176.268944:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.268950:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec3dcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.268970:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938176.268972:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938176.268973:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938176.272287:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.272310:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.272319:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.272325:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.272332:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.272341:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.272361:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac3861800) 00010000:00010000:0.0:1784938176.272382:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.272389:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.272395:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec3dc1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.316543:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.318826:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048722176 00000100:00100000:2.0:1784938176.318859:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048722176 00000100:00100000:2.0:1784938176.318959:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:2.0:1784938176.318972:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:10473:x1871643048722176:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938176.319004:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938176.319033:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3dd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979b3 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.319205:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.319272:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.319285:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.319299:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.319320:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.319324:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938176.320036:0:5805:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1784938176.320282:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320295:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320304:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320348:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320356:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320363:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320369:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.320374:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320382:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320409:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938176.320412:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938176.320419:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320426:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3ddd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938176.320441:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000044d19c6c reply state 000000007208ae02 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.320450:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938176.320489:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3dd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 34 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320504:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 33 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.320512:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938176.320515:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938176.320517:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892600, rc 0) 00000100:00100000:2.0:1784938176.322463:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:10473:x1871643048722176:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1656us (4100us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1784938176.322485:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00010000:00010000:1.0:1784938176.328459:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.328483:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.328513:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.328520:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938176.328526:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.328535:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.328565:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886be00) 00010000:00010000:1.0:1784938176.328570:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938176.328576:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.328583:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3de4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.333042:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.333624:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048722304 00000100:00100000:0.0:1784938176.333637:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048722304 00000100:00100000:0.0:1784938176.333722:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:0.0:1784938176.333731:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048722304:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938176.333752:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.333773:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979ba expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938176.333803:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938176.333823:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=385s v=(0 0) 00010000:00010000:0.0:1784938176.333827:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938176.333848:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 6 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.333875:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 6 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.333892:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00080000:1.0:1784938176.334286:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938176.334432:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048722304:12345-192.168.201.58@tcp:101:bash.0 Request processed in 699us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.334441:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784938176.341004:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.341338:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048722432 00000100:00100000:0.0:1784938176.341352:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048722432 00000100:00100000:0.0:1784938176.341457:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784938176.341469:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:10473:x1871643048722432:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938176.341492:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.341527:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979c1 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.341569:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.341580:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938176.341585:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938176.341590:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.341635:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 7 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.341651:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 7 pid: 6605 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.341668:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1871643065519104:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938176.341785:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c2097840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938176.344443:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.344573:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048722560 00000100:00100000:1.0:1784938176.344585:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048722560 00010000:00010000:1.0:1784938176.344650:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 8 pid: 6605 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.344704:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784938176.344716:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048722560:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938176.344736:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938176.344786:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 8 pid: 6605 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.344803:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 8 pid: 6605 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.344845:0:8373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938176.344850:0:8373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938176.344860:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.344871:0:8373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.344923:0:8373:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 8 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.344941:0:8373:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff818000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8373:1871643065519232:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784938176.345035:0:8373:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5480 going to sleep for 11 seconds 00010000:00010000:0.0:1784938176.346365:0:6602:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d6fa93/0xea86628a8aec3df9 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979ba expref: 8 pid: 6605 timeout: 485 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.346414:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1871643065519104:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938176.346448:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.346464:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:0.0:1784938176.346546:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:10473:x1871643048722432:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5079us (5558us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.346555:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784938176.348780:0:8373:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff818000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:8373:1871643065519232:192.168.201.58@tcp:105: 00010000:00010000:1.0:1784938176.348811:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938176.348901:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048722560:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 4187us (4471us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938176.348914:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784938176.351749:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.351865:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048722816 00000100:00100000:0.0:1784938176.351879:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048722816 00000100:00100000:0.0:1784938176.352068:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1784938176.352080:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:10473:x1871643048722816:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1784938176.352558:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:10473:x1871643048722816:12345-192.168.201.58@tcp:35:bash.0 Request processed in 478us (818us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1784938176.352567:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00010000:00010000:1.0:1784938176.372628:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938176.487575:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.487701:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048722944 00000100:00100000:2.0:1784938176.487715:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048722944 00000100:00100000:2.0:1784938176.487794:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:2.0:1784938176.487807:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:10489:x1871643048722944:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938176.487885:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938176.487914:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3e07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979c8 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.488008:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3e0e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.488025:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.488040:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938176.488116:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1784938176.488120:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938176.488147:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3e0e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.488176:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3e07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c8 expref: 36 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.488199:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3e0e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c8 expref: 35 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.488209:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938176.488212:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938176.488293:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938176.488370:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:10489:x1871643048722944:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 566us (810us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.488378:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:3.0:1784938176.492368:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.492553:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048723200 00000100:00100000:0.0:1784938176.492567:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048723200 00000100:00100000:0.0:1784938176.492654:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:0.0:1784938176.492667:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:10489:x1871643048723200:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938176.492696:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.492723:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3e15 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979cf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.492868:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.492904:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.492935:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.492953:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784938176.493120:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3e15 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979cf expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.493140:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979cf expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.493150:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:0.0:1784938176.493153:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938176.493158:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:0.0:1784938176.493279:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:10489:x1871643048723200:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 614us (926us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1784938176.493287:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:0.0:1784938176.498392:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.498480:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048723328 00000100:00100000:3.0:1784938176.498521:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048723328 00000100:00100000:3.0:1784938176.498602:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:3.0:1784938176.498621:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:2357:x1871643048723328:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938176.498642:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938176.498674:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979cf expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.498696:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:3.0:1784938176.498702:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938176.498825:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:2357:x1871643048723328:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 205us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938176.498842:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784938176.501715:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.502700:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048723584 00000100:00100000:0.0:1784938176.502716:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048723584 00000100:00100000:0.0:1784938176.502824:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:0.0:1784938176.502844:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:10489:x1871643048723584:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938176.502878:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.502909:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979d6 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.503108:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3e31 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.503126:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.503139:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3e31 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.503153:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784938176.503338:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979d6 expref: 39 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.503362:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979d6 expref: 38 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.503373:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:0.0:1784938176.503376:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784938176.503380:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a000, rc 0) 00000100:00100000:0.0:1784938176.503460:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:10489:x1871643048723584:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 618us (1758us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1784938176.503468:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:1.0:1784938176.508713:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.508835:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048723712 00000100:00100000:2.0:1784938176.508850:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048723712 00000100:00100000:2.0:1784938176.509016:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:2.0:1784938176.509031:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048723712:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:2.0:1784938176.509096:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.509122:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.509133:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938176.509139:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938176.509144:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.509188:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.509204:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 6 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.509246:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1871643065519360:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938176.509368:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938176.512691:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6604:1871643065519360:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938176.512729:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.513188:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.513288:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048723840 00000100:00100000:2.0:1784938176.513297:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048723840 00002000:00100000:2.0:1784938176.513362:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa05aff883480 x1871643048723840/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:407/0 lens 504/0 e 0 to 0 dl 1784938187 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938176.513372:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff883480 with x1871643048723840 ext(0->8) 00010000:00010000:2.0:1784938176.513381:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 7 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.513396:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 7 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938176.513404:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05aff883480 00000100:00100000:2.0:1784938176.513444:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1784938176.513456:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048723840:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:2.0:1784938176.514715:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2355:x1871643048723840:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 1249us (1517us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1784938176.514729:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00100000:2.0:1784938176.514740:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffffa05aff883480 x1871643048723840/t4294967302(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:407/0 lens 504/448 e 0 to 0 dl 1784938187 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938176.514752:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff883480 with x1871643048723840 ext(0->8) 00010000:00010000:2.0:1784938176.514761:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 9 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.514795:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 9 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938176.514803:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05aff883480 00000100:00100000:3.0:1784938176.517440:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.517544:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048723968 00000100:00100000:1.0:1784938176.517557:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048723968 00010000:00010000:1.0:1784938176.517619:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 9 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.517672:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:1.0:1784938176.517684:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2358:x1871643048723968:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938176.517703:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784938176.517731:0:5791:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1784938176.517734:0:5791:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1784938177 00002000:00010000:1.0:1784938176.517737:0:5791:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1784938177 00002000:00010000:1.0:1784938176.517739:0:5791:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1784938177 00010000:00010000:1.0:1784938176.517746:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 9 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.517761:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 9 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.517791:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003690c833/0xea86628a8aec3e00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c1 expref: 9 pid: 6602 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.517814:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938176.517818:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938176.517825:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.517871:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.518077:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938176.518145:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2358:x1871643048723968:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 462us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938176.518154:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00010000:00010000:2.0:1784938176.518440:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518452:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518487:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518615:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518626:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518633:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938176.518638:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518649:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518678:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.518686:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3e3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.518747:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048723712:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 9720us (10048us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.518755:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:1.0:1784938176.521741:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.521855:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048724224 00000100:00100000:2.0:1784938176.521868:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048724224 00000100:00100000:2.0:1784938176.522045:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:2.0:1784938176.522058:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:10489:x1871643048724224:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:2.0:1784938176.522142:0:5808:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3e31 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979d6 expref: 38 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938176.522705:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1784938176.522762:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1784938176.523490:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1784938176.523781:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.523803:0:5808:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.523814:0:5808:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.523883:0:5808:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 42 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.523903:0:5808:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 42 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.523996:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1871643065519488:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938176.524171:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104900 going to sleep for 11 seconds 00000100:00100000:2.0:1784938176.528482:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5808:1871643065519488:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938176.528528:0:5808:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.528967:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.529095:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048724352 00000100:00100000:2.0:1784938176.529106:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048724352 00010000:00010000:2.0:1784938176.529157:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 43 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.529207:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784938176.529358:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+43:2356:x1871643048724352:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938176.529379:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938176.529387:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 43 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.529400:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 43 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.529449:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979b3 expref: 43 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.529471:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938176.529476:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.529489:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.529584:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.529680:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938176.529785:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+42:2356:x1871643048724352:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 567us (818us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.529796:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00010000:00010000:0.0:1784938176.529867:0:5808:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.529876:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938176.530049:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1784938176.530321:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1784938176.530451:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1871643065519616:192.168.201.158@tcp:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784938176.531143:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aded6fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938176.532364:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938176.532614:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065519616 00000100:00100000:0.0:1784938176.532624:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065519616 00000100:00100000:0.0:1784938176.532739:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:0.0:1784938176.532750:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871643065519616:12345-192.168.201.158@tcp:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784938176.532878:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871643065519616:12345-192.168.201.158@tcp:1000:mdt_rdpg00_001.0 Request processed in 128us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.532886:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:2.0:1784938176.533258:0:5808:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:2.0:1784938176.533266:0:5808:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:2.0:1784938176.533293:0:5808:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aee237100, transno 4294967301 00000100:00100000:2.0:1784938176.533311:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bc380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1871643065519616:192.168.201.158@tcp:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784938176.533956:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:2.0:1784938176.534067:0:5808:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1871643065519744:192.168.201.158@tcp:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1784938176.534147:0:5808:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac51043c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938176.534329:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938176.534870:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065519744 00000100:00100000:0.0:1784938176.534879:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065519744 00000100:00100000:0.0:1784938176.534992:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:0.0:1784938176.535003:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5808:x1871643065519744:12345-192.168.201.158@tcp:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1784938176.535211:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5808:x1871643065519744:12345-192.168.201.158@tcp:1000:mdt_rdpg00_001.0 Request processed in 209us (882us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1784938176.535243:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:2.0:1784938176.535484:0:5808:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5808:1871643065519744:192.168.201.158@tcp:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1784938176.535638:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:2.0:1784938176.535692:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.535705:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.535714:0:5808:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.535720:0:5808:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.535726:0:5808:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.535735:0:5808:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.535755:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938176.535758:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1784938176.535765:0:5808:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.535771:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e46 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938176.536150:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1784938176.536428:0:5808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1784938176.536445:0:5808:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 385479228687ns, next at 386479226270ns, rc = 0 00000001:00080000:2.0:1784938176.536453:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:2.0:1784938176.536508:0:5808:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938176.536512:0:5808:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784938176.536534:0:5808:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3e31 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979d6 expref: 46 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.536661:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193cc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+45:10489:x1871643048724224:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 14604us (14936us total) trans 4294967388 rc 0/0 00000100:00100000:2.0:1784938176.536671:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000020:00080000:2.0:1784938176.536676:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:1.0:1784938176.536825:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938176.539572:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.539655:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048724480 00000100:00100000:0.0:1784938176.539668:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048724480 00000100:00100000:0.0:1784938176.539761:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:0.0:1784938176.539772:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+45:10489:x1871643048724480:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938176.539804:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.539845:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3e4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979dd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.540006:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979dd expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.540040:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3e4d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979dd expref: 46 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.540065:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938176.540068:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938176.540072:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:0.0:1784938176.540192:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+46:10489:x1871643048724480:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 421us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.540199:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:0.0:1784938176.543588:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.543687:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048724736 00000100:00100000:1.0:1784938176.543701:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048724736 00000100:00100000:1.0:1784938176.543775:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1784938176.543787:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+46:10489:x1871643048724736:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938176.544121:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:10489:x1871643048724736:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 336us (547us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1784938176.544130:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:2.0:1784938176.619477:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.619654:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048724864 00000100:00100000:3.0:1784938176.619667:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048724864 00000100:00100000:3.0:1784938176.619747:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1784938176.619758:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:10499:x1871643048724864:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784938176.619882:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.619904:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620133:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620154:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620181:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620188:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620363:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620373:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620381:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938176.620437:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620453:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620461:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620469:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620477:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938176.620482:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620491:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620525:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:3.0:1784938176.620528:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938176.620534:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620541:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec3e54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620558:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620565:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620571:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620576:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938176.620579:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620585:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620592:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac3861000) 00010000:00010000:3.0:1784938176.620595:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938176.620598:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620750:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620782:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620790:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620796:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620801:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938176.620806:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620811:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620819:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938176.620821:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938176.620824:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.620839:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.621019:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:10499:x1871643048724864:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1259us (1552us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938176.621029:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:0.0:1784938176.655911:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.656163:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048725120 00000100:00100000:2.0:1784938176.656176:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048725120 00000100:00100000:2.0:1784938176.656279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:2.0:1784938176.656291:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:10502:x1871643048725120:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938176.656317:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938176.656344:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979e4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656433:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656449:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656462:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656478:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656485:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656521:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656820:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656841:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.656849:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938176.656860:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1784938176.657046:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657056:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657062:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657069:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.657074:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657082:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657097:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:2.0:1784938176.657100:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938176.657113:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657120:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657136:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657142:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657147:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657153:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.657155:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657160:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657167:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886b800) 00010000:00010000:2.0:1784938176.657169:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938176.657171:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657177:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657376:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657403:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 49 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.657411:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:2.0:1784938176.657414:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938176.657416:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938176.657564:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:10502:x1871643048725120:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1274us (1664us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1784938176.657573:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:0.0:1784938176.662387:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.662486:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048725248 00000100:00100000:2.0:1784938176.663056:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048725248 00000100:00100000:2.0:1784938176.663183:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1784938176.663195:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:10502:x1871643048725248:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784938176.663311:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663332:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663346:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663378:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663385:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663413:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663420:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938176.663425:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663433:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663447:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:2.0:1784938176.663451:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938176.663456:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.663462:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3e8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.663716:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:10502:x1871643048725248:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 520us (1338us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.663725:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:3.0:1784938176.666079:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.666617:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048725504 00000100:00100000:1.0:1784938176.666629:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048725504 00000100:00100000:1.0:1784938176.666732:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:1.0:1784938176.666743:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:10502:x1871643048725504:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938176.667048:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:10502:x1871643048725504:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 306us (979us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1784938176.667056:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784938176.732099:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.732430:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048725760 00000100:00100000:1.0:1784938176.732442:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048725760 00000100:00100000:1.0:1784938176.732529:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:1.0:1784938176.732541:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:10512:x1871643048725760:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784938176.732574:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938176.732578:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784938176.732625:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3e0e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979c8 expref: 50 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.732648:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938176.732654:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938176.732672:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3e93 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979eb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.732796:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.732811:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.732821:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.732872:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 50 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.732888:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 50 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.733045:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff818000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065519872:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938176.733165:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5780 going to sleep for 11 seconds 00000100:00100000:0.0:1784938176.736929:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.737033:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff818000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065519872:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938176.737070:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.737179:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048725888 00000100:00100000:3.0:1784938176.737188:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048725888 00010000:00010000:3.0:1784938176.737281:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 51 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.737320:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:3.0:1784938176.737330:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:2355:x1871643048725888:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938176.737347:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938176.737355:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 51 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.737368:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 51 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.737394:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec3e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979e4 expref: 51 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.737414:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938176.737420:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.737430:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.737438:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.737463:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938176.737534:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:2355:x1871643048725888:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 205us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938176.737541:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00010000:00010000:0.0:1784938176.738108:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.738118:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.738141:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1784938176.738359:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3e93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.738378:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 50 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.738399:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938176.738402:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938176.738405:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991a00, rc 0) 00000100:00100000:0.0:1784938176.738453:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:10512:x1871643048725760:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5915us (6368us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1784938176.738461:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:0.0:1784938176.741863:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.741947:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048726144 00000100:00100000:3.0:1784938176.741960:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048726144 00000100:00100000:3.0:1784938176.742029:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1784938176.742039:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:10512:x1871643048726144:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:3.0:1784938176.742409:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.742429:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.742442:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938176.742493:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1784938176.742529:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec040311 reply state 000000002a29f194 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938176.742540:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938176.742640:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+53:10512:x1871643048726144:12345-192.168.201.58@tcp:36:bash.0 Request processed in 601us (789us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1784938176.742647:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 105 00000020:00080000:3.0:1784938176.742653:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938176.745532:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.745553:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.745561:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.745567:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.745573:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.745581:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.745602:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938176.745606:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.745611:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.745618:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec3ea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.747707:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.748208:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048726272 00000100:00100000:2.0:1784938176.748286:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048726272 00000100:00100000:2.0:1784938176.748397:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:2.0:1784938176.748409:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:10512:x1871643048726272:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938176.748440:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938176.748468:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3eaf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979f2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.748610:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.748629:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.748638:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.748682:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.748698:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 53 pid: 5804 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.748715:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065520000:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938176.748835:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac51046c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938176.751179:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.751285:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048726400 00000100:00100000:1.0:1784938176.751296:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048726400 00010000:00010000:1.0:1784938176.751342:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 54 pid: 5804 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938176.751390:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1784938176.751399:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:2356:x1871643048726400:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938176.751417:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938176.751425:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 54 pid: 5804 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.751440:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 54 pid: 5804 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.751465:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938176.751471:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.751481:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.751519:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.751543:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938176.751605:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:2356:x1871643048726400:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 206us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938176.751613:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00010000:00010000:2.0:1784938176.752146:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec3e9a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979eb expref: 53 pid: 5804 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.752166:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065520000:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938176.752195:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.752205:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.752263:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938176.752321:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1784938176.752326:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938176.752351:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.752388:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3eaf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 53 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.752405:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.752411:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:2.0:1784938176.752414:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938176.752417:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892600, rc 0) 00000100:00100000:2.0:1784938176.752588:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:10512:x1871643048726272:12345-192.168.201.58@tcp:101:bash.0 Request processed in 4180us (4890us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.752597:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:3.0:1784938176.757689:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.757798:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048726656 00000100:00100000:2.0:1784938176.757812:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048726656 00000100:00100000:2.0:1784938176.757891:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1784938176.757903:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:10512:x1871643048726656:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:2.0:1784938176.758457:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+53:10512:x1871643048726656:12345-192.168.201.58@tcp:35:bash.0 Request processed in 553us (779us total) trans 4294967395 rc 0/0 00000100:00100000:2.0:1784938176.758467:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:3.0:1784938176.821524:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.821671:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048726784 00000100:00100000:0.0:1784938176.821685:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048726784 00000100:00100000:0.0:1784938176.821765:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:0.0:1784938176.821776:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+53:10518:x1871643048726784:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938176.821813:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.821853:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3ebd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a8979f9 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.821940:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.824189:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.824238:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.824339:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1784938176.824344:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938176.824377:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.824421:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3ebd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f9 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.824450:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f9 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.824487:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938176.824490:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938176.824495:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b400, rc 0) 00000100:00100000:0.0:1784938176.824583:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048726784:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2808us (3071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.824593:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:1.0:1784938176.845562:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.845696:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048726912 00000100:00100000:0.0:1784938176.845709:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048726912 00000100:00100000:0.0:1784938176.845788:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 108 00000100:00100000:0.0:1784938176.845800:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048726912:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938176.845839:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938176.845870:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a00 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846169:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846190:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846204:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846259:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846267:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846295:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846411:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846419:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846427:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.846471:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784938176.846475:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938176.846498:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846511:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846522:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846528:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846536:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846542:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.846548:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846564:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846579:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938176.846582:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.846587:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846592:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec3ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846608:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846615:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846621:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846626:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938176.846629:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846635:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846641:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ac30f8600) 00010000:00010000:0.0:1784938176.846644:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938176.846646:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846662:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846703:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec3ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a00 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846720:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a00 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.846729:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938176.846731:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938176.846733:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031600, rc 0) 00000100:00100000:0.0:1784938176.846815:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10518:x1871643048726912:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1016us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938176.846833:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 108 00000100:00100000:1.0:1784938176.858551:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.858589:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.858700:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048727040 00000100:00100000:3.0:1784938176.858710:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048727040 00000100:00100000:3.0:1784938176.858791:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1784938176.858802:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:2355:x1871643048727040:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938176.858832:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938176.858879:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a00 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.858898:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938176.858903:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938176.858978:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:2355:x1871643048727040:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 177us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938176.858986:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1784938176.859073:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048727296 00000100:00100000:2.0:1784938176.859078:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048727296 00000100:00100000:2.0:1784938176.859119:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:2.0:1784938176.859126:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048727296:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938176.859148:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938176.859168:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ee7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a07 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.859349:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.859365:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.859375:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.859418:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.859434:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 55 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938176.859450:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065520128:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938176.859544:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac51046c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938176.862450:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938176.862555:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048727424 00000100:00100000:0.0:1784938176.862566:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048727424 00000100:00100000:2.0:1784938176.862618:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeafb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065520128:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938176.862654:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.862886:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 56 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938176.863056:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:0.0:1784938176.863068:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:2356:x1871643048727424:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938176.863087:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938176.863096:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 56 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.863124:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 56 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.863479:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec3eb6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f2 expref: 56 pid: 5805 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.863501:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938176.863507:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.863517:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.863526:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.864012:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938176.864090:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:2356:x1871643048727424:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1019us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.864100:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00010000:00010000:0.0:1784938176.864201:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.864210:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938176.864260:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1784938176.864455:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec3ee7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 56 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.864474:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 55 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938176.864504:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938176.864510:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938176.864514:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:0.0:1784938176.864546:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10518:x1871643048727296:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 5420us (5954us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1784938176.864553:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:0.0:1784938176.871163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938176.871408:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048727680 00000100:00100000:1.0:1784938176.871424:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048727680 00000100:00100000:1.0:1784938176.871514:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1784938176.871529:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10518:x1871643048727680:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:1.0:1784938176.871550:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938176.871582:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec3e4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979dd expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938176.871607:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938176.871612:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938176.872152:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048727680:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 626us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938176.872163:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1784938176.878473:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938176.878629:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048727808 00000100:00100000:2.0:1784938176.878643:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048727808 00000100:00100000:2.0:1784938176.878721:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:2.0:1784938176.878733:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048727808:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:2.0:1784938176.878885:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.878907:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938176.878922:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938176.879170:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1784938176.879701:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048727808:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 967us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938176.879710:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:0.0:1784938176.887695:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938176.887798:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048727936 00000100:00100000:3.0:1784938176.887811:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048727936 00000100:00100000:3.0:1784938176.887895:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:3.0:1784938176.887914:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:10518:x1871643048727936:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938176.887941:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938176.887970:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a0e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.888046:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.888059:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.888082:0:5806:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.888097:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.888114:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938176.888135:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938176.888140:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938176.888148:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d000, rc 0) 00000100:00100000:3.0:1784938176.888271:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10518:x1871643048727936:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 366us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938176.888279:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 111 00000040:00080000:3.0:1784938177.009575:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938177.009587:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938177.009671:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1784938177.009681:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938177.009871:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff880a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065520256:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784938177.009995:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac14e73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938177.015172:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938177.015626:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff880a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065520256:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938177.016136:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048728064 00000100:00100000:1.0:1784938177.016162:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048728064 00000100:00100000:1.0:1784938177.016259:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:1.0:1784938177.016270:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10519:x1871643048728064:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784938177.016313:0:5804:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784938177.016465:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10519:x1871643048728064:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 196us (1310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938177.016480:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:2.0:1784938177.031342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.031518:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048728192 00000100:00100000:0.0:1784938177.031532:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048728192 00000100:00100000:0.0:1784938177.031604:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:0.0:1784938177.031615:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10519:x1871643048728192:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784938177.031720:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031742:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031757:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031778:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031785:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031816:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031862:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031871:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031879:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938177.031937:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784938177.031942:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938177.031959:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031985:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.031993:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032002:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032010:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938177.032015:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032024:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032046:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:0.0:1784938177.032050:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938177.032056:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032063:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f0a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032079:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032086:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032092:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032098:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938177.032100:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032107:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032114:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffffa05ac30f8600) 00010000:00010000:0.0:1784938177.032117:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938177.032120:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032127:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f11 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032155:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032161:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032168:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032174:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938177.032177:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032184:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032192:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938177.032194:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938177.032197:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.032204:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec3f18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938177.032368:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10519:x1871643048728192:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 754us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.032378:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:0.0:1784938177.037031:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938177.037133:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048728448 00000100:00100000:1.0:1784938177.037148:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048728448 00000100:00100000:1.0:1784938177.037250:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:1.0:1784938177.037262:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:10519:x1871643048728448:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938177.037290:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938177.037317:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f1f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a15 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037451:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037469:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037482:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938177.037496:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784938177.037630:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037639:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037664:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037670:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938177.037675:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037683:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037698:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938177.037701:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938177.037707:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037714:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037769:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f1f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a15 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037780:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:1.0:1784938177.037783:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938177.037786:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f1f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a15 expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.037795:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991800, rc 0) 00000100:00100000:1.0:1784938177.037891:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:10519:x1871643048728448:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 631us (875us total) trans 4294967397 rc 301/301 00000100:00100000:1.0:1784938177.037911:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:2.0:1784938177.045684:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.046477:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048728576 00000100:00100000:0.0:1784938177.046492:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048728576 00000100:00100000:0.0:1784938177.046596:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:0.0:1784938177.046609:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:10519:x1871643048728576:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784938177.046660:0:7211:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784938177.046941:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee237100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:10519:x1871643048728576:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 333us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.046950:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:3.0:1784938177.056421:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938177.065431:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048728832 00000100:00100000:1.0:1784938177.065452:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048728832 00000100:00100000:1.0:1784938177.065600:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1784938177.065613:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:10519:x1871643048728832:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938177.065641:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938177.065645:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1784938177.065682:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec3ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8979f9 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.065704:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938177.065709:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938177.065728:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f34 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a1c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938177.066323:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1784938177.066568:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.066584:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.066595:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.066657:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f34 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a1c expref: 58 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.066697:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a1c expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.066705:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ac7d1dc00) 00010000:00010000:1.0:1784938177.066708:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938177.066711:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991e00, rc 0) 00000100:00100000:1.0:1784938177.066797:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:10519:x1871643048728832:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1187us (10391us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1784938177.066806:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:0.0:1784938177.072330:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938177.072636:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048729088 00000100:00100000:1.0:1784938177.072662:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048729088 00000100:00100000:1.0:1784938177.072741:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:1.0:1784938177.072752:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:10519:x1871643048729088:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938177.072852:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938177.072888:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a1c expref: 57 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.072912:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ac7d1dc00) 00010000:00010000:1.0:1784938177.072927:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938177.072954:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.072974:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.072984:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073017:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073024:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073030:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073279:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073287:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073293:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073299:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938177.073304:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073311:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073320:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938177.073323:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938177.073328:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073335:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec3f49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073353:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073360:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073366:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073370:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938177.073373:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073379:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073386:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc52bf1d8 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938177.073388:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938177.073390:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.073395:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec3f50 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc52bf1d8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938177.073496:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:10519:x1871643048729088:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 744us (1181us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938177.073504:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:0.0:1784938177.074026:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065520384:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938177.074527:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938177.074697:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065520384 00000100:00100000:1.0:1784938177.074707:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065520384 00000100:00100000:1.0:1784938177.074763:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 64 00000100:00100000:1.0:1784938177.074786:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1871643065520384:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938177.074815:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938177.074879:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1871643065520384:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 95us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938177.074887:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 64 00000100:00100000:0.0:1784938177.075565:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff880380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065520384:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938177.079686:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.080535:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048729216 00000100:00100000:2.0:1784938177.080551:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048729216 00000100:00100000:2.0:1784938177.080616:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:2.0:1784938177.080627:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:10519:x1871643048729216:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938177.080688:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938177.080722:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3f57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a23 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.080766:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.080782:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.080795:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.080929:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec3f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 58 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.080949:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.080961:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938177.080963:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938177.080967:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938177.081796:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:10519:x1871643048729216:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1164us (2119us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.081807:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:3.0:1784938177.093301:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.093499:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048729472 00000100:00100000:0.0:1784938177.093513:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048729472 00000100:00100000:0.0:1784938177.093592:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:0.0:1784938177.093604:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:10519:x1871643048729472:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938177.093740:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.093763:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.093777:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938177.094126:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1784938177.094286:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039432bc5 reply state 00000000b5613b90 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938177.094325:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938177.094463:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:10519:x1871643048729472:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 859us (1174us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1784938177.094472:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1784938177.096798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.096896:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048729600 00000100:00100000:0.0:1784938177.096909:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048729600 00000100:00100000:0.0:1784938177.096983:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1784938177.096996:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:10519:x1871643048729600:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938177.097031:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938177.097057:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a2a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.097133:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.097151:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.097174:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:0.0:1784938177.097178:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938177.097184:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031800, rc 0) 00000100:00100000:0.0:1784938177.097321:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:10519:x1871643048729600:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 327us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.097329:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00010000:00010000:2.0:1784938177.098297:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.098313:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.098344:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.098352:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938177.098358:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.098367:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.098384:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938177.098388:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784938177.098393:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.098400:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3f65 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938177.105058:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.105145:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048729728 00000100:00100000:2.0:1784938177.105159:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048729728 00000100:00100000:2.0:1784938177.105276:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:2.0:1784938177.105290:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2358:x1871643048729728:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1784938177.105681:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2358:x1871643048729728:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 393us (637us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1784938177.105690:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00080000:1.0:1784938177.107927:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938177.108302:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.108440:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048729984 00000100:00100000:2.0:1784938177.108453:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048729984 00000100:00100000:2.0:1784938177.108523:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:2.0:1784938177.108535:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:10519:x1871643048729984:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784938177.108883:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:10519:x1871643048729984:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 348us (586us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1784938177.108891:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:3.0:1784938177.119496:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.119794:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048730240 00000100:00100000:0.0:1784938177.119838:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048730240 00000100:00100000:0.0:1784938177.120071:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:0.0:1784938177.120085:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:10519:x1871643048730240:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784938177.120284:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:10519:x1871643048730240:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 202us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.120302:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:3.0:1784938177.122776:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938177.122910:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048730368 00000100:00100000:1.0:1784938177.122923:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048730368 00000100:00100000:1.0:1784938177.126810:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:1.0:1784938177.126842:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:10519:x1871643048730368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938177.126879:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938177.126928:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f73 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a31 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.127029:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.127048:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.127063:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938177.127112:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938177.127136:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.127169:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec3f73 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a31 expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.127212:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a31 expref: 61 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.127266:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:1.0:1784938177.127270:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1784938177.127274:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990200, rc 0) 00000100:00100000:1.0:1784938177.127483:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:10519:x1871643048730368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 645us (4720us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938177.127491:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:1.0:1784938177.131882:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.131987:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048730496 00000100:00100000:0.0:1784938177.132001:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048730496 00000100:00100000:0.0:1784938177.132110:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784938177.132124:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2356:x1871643048730496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938177.132150:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938177.132181:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a38 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938177.132262:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63fec2, blocks: 0x1 00010000:00010000:0.0:1784938177.132289:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1784938177.132295:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938177.132307:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 10 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.132330:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 10 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.132348:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031600, rc 0) 00000100:00100000:0.0:1784938177.132424:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2356:x1871643048730496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 304us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.132453:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1784938177.147114:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.147279:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048730752 00000100:00100000:2.0:1784938177.147295:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048730752 00000100:00100000:2.0:1784938177.147375:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:2.0:1784938177.147388:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:10519:x1871643048730752:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1784938177.147544:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:10519:x1871643048730752:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 158us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.147554:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:3.0:1784938177.150335:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.150470:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048730880 00000100:00100000:2.0:1784938177.150484:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048730880 00000100:00100000:2.0:1784938177.150640:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784938177.150651:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:10519:x1871643048730880:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938177.150676:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938177.150704:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a3f expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.150746:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.150755:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938177.150760:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938177.150767:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 11 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.150846:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.150864:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.150881:0:8127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1871643065520512:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938177.151807:0:8127:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104b40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938177.155731:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.155909:0:8127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1871643065520512:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938177.155953:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 11 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.155981:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938177.156066:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:10519:x1871643048730880:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 5416us (5745us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.156075:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:0.0:1784938177.158098:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731008 00000100:00100000:0.0:1784938177.158115:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731008 00010000:00010000:0.0:1784938177.158174:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.158331:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1784938177.158345:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:2355:x1871643048731008:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938177.158364:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938177.158393:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.158409:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.158453:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec3f81 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a38 expref: 11 pid: 6605 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.158483:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938177.158488:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938177.158499:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 10 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.158510:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 10 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.158804:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 10 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.158834:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871643065520640:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784938177.158959:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104b40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938177.162157:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5792:1871643065520640:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784938177.162196:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938177.162298:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2355:x1871643048731008:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 3955us (6580us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.162320:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:3.0:1784938177.166997:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.167120:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731136 00000100:00100000:0.0:1784938177.167135:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731136 00002000:00100000:0.0:1784938177.167202:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa05aff873b80 x1871643048731136/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:408/0 lens 504/0 e 0 to 0 dl 1784938188 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938177.167254:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff873b80 with x1871643048731136 ext(0->12) 00002000:00010000:0.0:1784938177.167261:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aff873b80 00000100:00100000:0.0:1784938177.167291:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784938177.167301:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2355:x1871643048731136:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784938177.168155:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff873b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:2355:x1871643048731136:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 850us (1167us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1784938177.168166:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00002000:00100000:0.0:1784938177.168176:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffffa05aff873b80 x1871643048731136/t4294967308(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:408/0 lens 504/448 e 0 to 0 dl 1784938188 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938177.168186:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff873b80 with x1871643048731136 ext(0->12) 00002000:00010000:0.0:1784938177.168191:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aff873b80 00000100:00100000:1.0:1784938177.180975:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938177.181266:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731264 00000100:00100000:3.0:1784938177.181280:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731264 00000100:00100000:3.0:1784938177.181715:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:3.0:1784938177.181728:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:10519:x1871643048731264:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1784938177.268065:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000001:00080000:3.0:1784938177.268188:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1784938177.268212:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1784938177.268257:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05ac5104600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1784938177.268262:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ac4fc8600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05ac5104900 00000020:00080000:3.0:1784938177.268265:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ac4fc8300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05aedf92800 00000020:00080000:3.0:1784938177.268292:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05acb17a780 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1784938177.268296:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05afc8b3100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05acb17a480 00000020:00080000:3.0:1784938177.268299:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05afc8b3a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05aedeadc00 00000004:00080000:3.0:1784938177.268316:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1784938177.268497:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1784938177.268710:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1784938177.268790:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065520768:192.168.201.158@tcp:6:osp-syn-0-0.0 00000100:00100000:3.0:1784938177.268947:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938177.268954:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065520896:192.168.201.158@tcp:6:osp-syn-1-0.0 00000100:00100000:3.0:1784938177.269191:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938177.269307:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938177.269630:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10519:x1871643048731264:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 87902us (88670us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.269642:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:2.0:1784938177.269705:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065520768 00000100:00100000:2.0:1784938177.269714:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065520768 00000100:00100000:2.0:1784938177.269755:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065520896 00000100:00100000:2.0:1784938177.269758:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065520896 00000100:00100000:2.0:1784938177.269796:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:2.0:1784938177.269806:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1871643065520768:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938177.269848:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1784938177.269891:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a63fec1, atime: 0x6a63fec1, ctime: 0x6a63fec1, blocks: 0x1 00010000:00010000:2.0:1784938177.269911:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.269930:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=386s v=(0 0) 00010000:00010000:2.0:1784938177.269935:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938177.269943:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.269962:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.269974:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.269982:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.270004:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938177.270586:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff872d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065520768:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 Request processed in 778us (1392us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1784938177.270605:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 40 00000100:00100000:2.0:1784938177.270627:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 41 00000100:00100000:2.0:1784938177.270636:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1871643065520896:12345-192.168.201.158@tcp:6:osp-syn-1-0.0 00002000:00080000:2.0:1784938177.270655:0:6604:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1784938177.270674:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.270690:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 11 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.270700:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1784938177.270703:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938177.270708:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.270743:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 11 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.270760:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 11 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.270775:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065521024:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938177.270841:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104240 going to sleep for 11 seconds 00000100:00080000:1.0:1784938177.274763:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:3.0:1784938177.274838:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aff873100/2, rc 0, transno 4294967304 00000100:00100000:3.0:1784938177.274855:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff873100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065520768:192.168.201.158@tcp:6:osp-syn-0-0.0 00010000:00010000:0.0:1784938177.275341:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938177.275352:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.275395:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938177.275400:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.275413:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.275439:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.275446:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b899e153/0xea86628a8aec3f8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.275476:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938177.275478:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938177.275479:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938177.276048:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938177.276125:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.276197:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731520 00000100:00100000:0.0:1784938177.276207:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731520 00000100:00100000:0.0:1784938177.276306:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784938177.276317:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:2356:x1871643048731520:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1784938177.276454:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065521024:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938177.276504:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938177.280942:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731392 00000100:00100000:1.0:1784938177.280963:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731392 00010000:00010000:1.0:1784938177.281023:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 13 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938177.281069:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1784938177.281079:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2355:x1871643048731392:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938177.281100:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938177.281107:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 13 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.281123:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 13 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.281172:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec3d51 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89799e expref: 13 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.281193:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938177.281198:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938177.281204:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.281231:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.281264:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938177.281345:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:2355:x1871643048731392:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 266us (5300us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938177.281354:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00010000:00010000:2.0:1784938177.283712:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.283738:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.283752:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.283762:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.283788:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938177.284665:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff872680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065520896:12345-192.168.201.158@tcp:6:osp-syn-1-0.0 Request processed in 14021us (15347us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1784938177.284679:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 41 00010000:00010000:2.0:1784938177.284723:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938177.284731:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.284743:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938177.284748:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.284773:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.284798:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.284807:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3f96 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.284841:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938177.284843:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938177.284845:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1784938177.285295:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aff871f80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1784938177.285320:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff871f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065520896:192.168.201.158@tcp:6:osp-syn-1-0.0 00000001:00080000:3.0:1784938177.312448:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1784938177.312481:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1784938177.312683:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff870e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048731520:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 36359us (36548us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.312697:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1784938177.315959:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.316246:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731776 00000100:00100000:2.0:1784938177.316260:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731776 00000100:00100000:2.0:1784938177.316342:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:2.0:1784938177.316354:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10519:x1871643048731776:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784938177.316435:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938177.316477:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3f7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a31 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.316516:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938177.316595:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938177.316715:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.316733:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.316744:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938177.317836:0:7211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000e89156a reply state 000000002448e46a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.317853:0:7211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938177.318368:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff871180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:10519:x1871643048731776:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 2009us (2416us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1784938177.318381:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1784938177.321576:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:1.0:1784938177.321663:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.321679:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.321688:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.321694:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938177.321701:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.321732:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.321755:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:1.0:1784938177.321759:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938177.321766:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.321773:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3f9d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.321857:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048731904 00000100:00100000:2.0:1784938177.321871:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048731904 00000100:00100000:2.0:1784938177.321946:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784938177.321958:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048731904:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784938177.322270:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1784938177.322274:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784938177 00002000:00010000:2.0:1784938177.322276:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784938177 00002000:00010000:2.0:1784938177.322279:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1784938178 -> 1784938177 00002000:00010000:2.0:1784938177.322281:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784938177.322780:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff872a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048731904:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 820us (1214us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784938177.322792:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:3.0:1784938177.325414:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.325559:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048732160 00000100:00100000:0.0:1784938177.325573:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048732160 00000100:00100000:0.0:1784938177.325646:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:0.0:1784938177.325658:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:10519:x1871643048732160:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784938177.325766:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.325810:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.325834:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.325882:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.326043:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 15 pid: 5805 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938177.326064:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065521152:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938177.326167:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938177.332737:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065521152:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938177.332792:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938177.333091:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938177.333695:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048732288 00000100:00100000:3.0:1784938177.333706:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048732288 00010000:00010000:3.0:1784938177.333756:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 16 pid: 5805 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.333844:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1784938177.333858:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:2356:x1871643048732288:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938177.333879:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938177.333888:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 16 pid: 5805 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.333915:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 16 pid: 5805 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.333945:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec3f5e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a23 expref: 16 pid: 5805 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.333966:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:3.0:1784938177.333971:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.333983:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.334004:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.334041:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938177.334124:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:2356:x1871643048732288:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 268us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938177.334133:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00010000:00010000:0.0:1784938177.334516:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334538:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334579:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334588:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334596:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334625:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938177.334630:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334639:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334649:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:0.0:1784938177.334653:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784938177.334657:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.334664:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec3fa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938177.334733:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff873480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10519:x1871643048732160:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 9075us (9334us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784938177.334743:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:0.0:1784938177.338352:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.338441:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048732416 00000100:00100000:2.0:1784938177.338454:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048732416 00000100:00100000:2.0:1784938177.338673:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:2.0:1784938177.338686:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048732416:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784938177.338753:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.338777:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.338788:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938177.338794:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938177.338799:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.338854:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 7 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.338872:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 7 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.338890:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065521280:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938177.339008:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938177.343032:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.343156:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065521280:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938177.343199:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.343331:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048732544 00000100:00100000:3.0:1784938177.343340:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048732544 00010000:00010000:3.0:1784938177.343393:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 8 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.343441:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:3.0:1784938177.343451:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048732544:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938177.343472:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938177.343502:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 8 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.343518:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 8 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.343559:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec3f88 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a3f expref: 8 pid: 8127 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.343579:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938177.343584:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938177.343620:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.343632:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.343668:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938177.343734:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048732544:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 284us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938177.343744:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00010000:00010000:2.0:1784938177.343920:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.343932:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.343964:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.343974:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.343984:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.343992:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938177.343997:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.344008:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.344034:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.344043:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009dcfeb23/0xea86628a8aec3fab lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.344097:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048732416:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 5414us (5758us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.344107:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:1.0:1784938177.348163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938177.348343:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048732800 00000100:00100000:3.0:1784938177.348357:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048732800 00000100:00100000:3.0:1784938177.348433:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:3.0:1784938177.348445:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10519:x1871643048732800:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938177.348570:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.348596:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.348621:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.348921:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.348936:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.348946:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.349013:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.349029:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 15 pid: 5806 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.349048:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff870700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065521408:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938177.349155:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938177.352909:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.353062:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048732928 00000100:00100000:2.0:1784938177.353075:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048732928 00010000:00010000:2.0:1784938177.353133:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 16 pid: 5806 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.353186:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1784938177.353197:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:2356:x1871643048732928:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938177.353258:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938177.353267:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 16 pid: 5806 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.353283:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 16 pid: 5806 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.353314:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:2.0:1784938177.353321:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.353351:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.353360:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.353385:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938177.353450:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:2356:x1871643048732928:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 254us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.353459:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00010000:00010000:3.0:1784938177.354141:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec3f6c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a2a expref: 15 pid: 5806 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.354165:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff870700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065521408:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938177.354193:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.354205:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.354211:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938177.354483:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1784938177.354966:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1784938177.355024:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1784938177.355144:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1871643065521536:192.168.201.158@tcp:1000:mdt00_002.0 00000100:00100000:2.0:1784938177.355288:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938177.356096:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938177.356508:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065521536 00000100:00100000:2.0:1784938177.356521:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065521536 00000100:00100000:2.0:1784938177.356758:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:2.0:1784938177.356770:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1871643065521536:12345-192.168.201.158@tcp:1000:mdt00_002.0 00000100:00100000:2.0:1784938177.357008:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff870700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1871643065521536:12345-192.168.201.158@tcp:1000:mdt00_002.0 Request processed in 237us (914us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.357018:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:2.0:1784938177.358703:0:5806:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1784938177.358716:0:5806:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1784938177.358749:0:5806:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa05aff871f80 x1871643065520896/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938193 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938177.358764:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1871643065521536:192.168.201.158@tcp:1000:mdt00_002.0 00000001:00080000:2.0:1784938177.359739:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1784938177.359867:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1871643065521664:192.168.201.158@tcp:1000:mdt00_002.0 00000100:00100000:2.0:1784938177.360107:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104240 going to sleep for 11 seconds 00000100:00100000:1.0:1784938177.360414:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938177.360649:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065521664 00000100:00100000:2.0:1784938177.360659:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065521664 00000100:00100000:2.0:1784938177.360729:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:2.0:1784938177.360739:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1871643065521664:12345-192.168.201.158@tcp:1000:mdt00_002.0 00000100:00100000:2.0:1784938177.361200:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5806:x1871643065521664:12345-192.168.201.158@tcp:1000:mdt00_002.0 Request processed in 459us (784us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1784938177.361210:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:3.0:1784938177.361713:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee235180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5806:1871643065521664:192.168.201.158@tcp:1000:mdt00_002.0 00010000:00010000:3.0:1784938177.361769:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.361799:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.361808:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.361828:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87de00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938177.361834:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.361843:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.361864:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ad886b800) 00010000:00010000:3.0:1784938177.361868:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938177.361875:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.361882:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fb9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362141:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362149:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362155:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362160:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938177.362171:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362177:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362187:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938177.362190:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938177.362196:0:5806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362210:0:5806:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362254:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.362304:0:5806:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.362320:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff873800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065521792:192.168.201.58@tcp:105: 00000100:00100000:3.0:1784938177.362402:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938177.366257:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.366382:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff873800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065521792:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784938177.366422:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366436:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3efc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366480:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366497:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366511:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366536:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366566:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366573:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366580:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938177.366584:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366593:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366609:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:2.0:1784938177.366612:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938177.366616:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366622:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fc0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366634:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366640:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366647:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366652:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938177.366664:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366672:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366681:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:2.0:1784938177.366684:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938177.366687:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.366694:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec3fb2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938177.367003:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:10519:x1871643048732800:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 18558us (18855us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1784938177.367015:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000020:00080000:2.0:1784938177.367023:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1784938177.367363:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938177.367369:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938177.367884:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1784938177.367906:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938177.368660:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048733056 00000100:00100000:0.0:1784938177.368673:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048733056 00000100:00100000:0.0:1784938177.368744:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:0.0:1784938177.368757:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:10518:x1871643048733056:12345-192.168.201.58@tcp:49:lfs.0 00000100:00100000:0.0:1784938177.368958:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff870000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:10518:x1871643048733056:12345-192.168.201.58@tcp:49:lfs.0 Request processed in 202us (2753us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.368967:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1784938177.376547:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938177.376675:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048733312 00000100:00100000:0.0:1784938177.376708:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048733312 00000100:00100000:0.0:1784938177.376783:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:0.0:1784938177.376795:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:10519:x1871643048733312:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784938177.387749:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.388079:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048733568 00000100:00100000:2.0:1784938177.388093:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048733568 00000100:00100000:2.0:1784938177.388185:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:2.0:1784938177.388198:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10518:x1871643048733568:12345-192.168.201.58@tcp:58:lfs.0 00000040:00080000:2.0:1784938177.388741:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1784938177.388863:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff871500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10518:x1871643048733568:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 666us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938177.388872:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 128 00000004:00080000:1.0:1784938177.390534:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1784938177.390675:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1784938177.390770:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.390794:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.390809:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.390831:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.390839:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.390860:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938177.390888:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938177.391168:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938177.391176:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.391184:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938177.391189:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.391198:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.391242:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:0.0:1784938177.391246:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784938177.391252:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.391258:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec3fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.391280:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938177.391283:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938177.391285:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938177.400367:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938177.401352:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10519:x1871643048733312:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 24546us (24807us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1784938177.401372:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000020:00080000:1.0:1784938177.401384:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784938177.429485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938177.429768:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048733696 00000100:00100000:2.0:1784938177.429781:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048733696 00000100:00100000:2.0:1784938177.429887:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:2.0:1784938177.429984:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:10521:x1871643048733696:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938177.430021:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938177.430049:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fce lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a46 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.430134:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.430153:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.430167:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.430185:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.430192:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938177.430199:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.430801:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.430826:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.430835:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.430884:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.430901:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 21 pid: 7211 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.430918:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff870a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065521920:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938177.431111:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938177.440936:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938177.441043:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048733952 00000100:00100000:0.0:1784938177.441142:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff870a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065521920:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938177.441180:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938177.442973:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048733952 00000100:00100000:1.0:1784938177.443078:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784938177.443091:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:9924:x1871643048733952:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1784938177.443463:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff870380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:9924:x1871643048733952:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 373us (2540us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1784938177.443472:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1784938177.445417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938177.445499:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048734080 00000100:00100000:3.0:1784938177.445512:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048734080 00010000:00010000:3.0:1784938177.445564:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 23 pid: 7211 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938177.445668:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:3.0:1784938177.445681:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:2355:x1871643048734080:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938177.445701:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938177.445710:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 23 pid: 7211 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.445731:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 23 pid: 7211 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.445760:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec3eee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a07 expref: 23 pid: 7211 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.445783:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938177.445789:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.445799:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.445807:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938177.445864:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938177.445942:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea1450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:2355:x1871643048734080:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 264us (537us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938177.445951:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00010000:00010000:0.0:1784938177.446072:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446082:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938177.446139:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1784938177.446144:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938177.446173:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446188:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446199:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446207:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446253:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446262:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938177.446267:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446289:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446300:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:0.0:1784938177.446303:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938177.446308:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446324:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec3fd5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446338:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446345:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446352:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446357:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938177.446360:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446366:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446374:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffffa05ad886bd00) 00010000:00010000:0.0:1784938177.446377:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938177.446380:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446386:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec3fdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446427:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec3fce lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a46 expref: 22 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446444:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a46 expref: 21 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938177.446459:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:0.0:1784938177.446462:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938177.446464:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87da00, rc 0) 00000100:00100000:0.0:1784938177.446503:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff871880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10521:x1871643048733696:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 16523us (17034us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938177.446511:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00000040:00080000:1.0:1784938178.192941:0:11971:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938178.193106:0:11971:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938178.193174:0:11971:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784938178.193181:0:11971:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1784938178.425293:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938178.438077:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938178.438086:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938178.438156:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1784938178.438165:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938178.438354:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff819c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065522048:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938178.438470:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938178.471077:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938178.471119:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048734208 00000100:00100000:2.0:1784938178.471131:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048734208 00000100:00100000:2.0:1784938178.471209:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:2.0:1784938178.471244:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:10533:x1871643048734208:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784938178.472625:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784938178.472788:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:10533:x1871643048734208:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 1542us (1722us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938178.472815:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00080000:2.0:1784938178.472856:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938178.475662:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff819c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065522048:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938178.495340:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938178.495492:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048734464 00000100:00100000:3.0:1784938178.495514:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048734464 00000100:00100000:3.0:1784938178.495593:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:3.0:1784938178.495605:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:10533:x1871643048734464:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938178.495637:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938178.495665:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fea lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a4d expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938178.495835:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3ff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938178.495853:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938178.495866:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938178.495892:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1784938178.496074:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec3fea lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a4d expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938178.496097:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a4d expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938178.496108:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938178.496112:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938178.496116:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87ce00, rc 0) 00000100:00100000:3.0:1784938178.496200:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:10533:x1871643048734464:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 597us (876us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1784938178.496208:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:0.0:1784938178.508182:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938178.509831:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048734720 00000100:00100000:1.0:1784938178.509870:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048734720 00000100:00100000:1.0:1784938178.510010:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:1.0:1784938178.510023:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:10533:x1871643048734720:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784938178.510146:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.510167:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.510181:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.510483:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.510494:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.511146:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.511156:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938178.511161:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.511170:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.511187:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938178.511190:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938178.511196:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938178.511259:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec3fff lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938178.511804:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10533:x1871643048734720:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 1769us (3624us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1784938178.511817:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 132 00000040:00080000:2.0:1784938178.513000:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938178.513010:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1784938178.514638:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938178.514757:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048734848 00000100:00100000:3.0:1784938178.514770:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048734848 00000100:00100000:3.0:1784938178.514865:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1784938178.514878:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:2356:x1871643048734848:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938178.514934:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938178.514966:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec3ff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a4d expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938178.514995:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938178.515003:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938178.515074:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff872300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:2356:x1871643048734848:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 197us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938178.515083:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000040:00080000:2.0:1784938178.515850:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1784938178.515868:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938178.519157:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938178.519739:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048735104 00000100:00100000:0.0:1784938178.519754:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048735104 00000100:00100000:0.0:1784938178.519842:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:0.0:1784938178.519855:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:10533:x1871643048735104:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784938178.521140:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10533:x1871643048735104:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1279us (1991us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1784938178.521154:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:3.0:1784938179.121729:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065522432:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938179.121912:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938179.121921:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065522560:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938179.122317:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938179.122417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938179.122447:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522432 00000100:00100000:2.0:1784938179.122456:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522432 00000100:00100000:2.0:1784938179.122528:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 143 00000100:00100000:2.0:1784938179.122539:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065522432:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938179.122677:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065522432:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 140us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938179.122685:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 143 00000100:00080000:2.0:1784938179.122710:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938179.122857:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065522176:0@lo:400:kworker.0 00000100:00100000:1.0:1784938179.122905:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938179.122952:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065522688:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.122988:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1784938179.122994:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065522304:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.123017:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065522816:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.123049:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522560 00000100:00100000:1.0:1784938179.123054:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522560 00000100:00100000:1.0:1784938179.123092:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 77 00000100:00100000:1.0:1784938179.123100:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065522560:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.123129:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065522560:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 31us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938179.123137:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 77 00000100:00080000:1.0:1784938179.123153:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938179.123270:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938179.123289:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938179.123309:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938179.123339:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522688 00000100:00100000:1.0:1784938179.123361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522688 00000100:00100000:1.0:1784938179.123386:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522304 00000100:00100000:1.0:1784938179.123389:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522304 00000100:00100000:1.0:1784938179.123402:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 144 00000100:00100000:1.0:1784938179.123408:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065522688:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.123440:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065522688:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 31us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938179.123446:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 144 00000100:00100000:1.0:1784938179.123457:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 145 00000100:00100000:1.0:1784938179.123463:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065522304:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.123487:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff819500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065522304:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938179.123494:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 145 00000100:00080000:1.0:1784938179.123506:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938179.123636:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065522304:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.123649:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065522688:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938179.124126:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522816 00000100:00100000:0.0:1784938179.124132:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522816 00000100:00100000:0.0:1784938179.124174:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 78 00000100:00100000:0.0:1784938179.124182:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065522816:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938179.124244:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065522816:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 63us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938179.124251:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 78 00000100:00080000:0.0:1784938179.124273:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938179.125251:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065522560:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938179.125273:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee234a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065522432:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938179.125897:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522176 00000100:00100000:2.0:1784938179.125909:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522176 00000100:00100000:2.0:1784938179.125992:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1784938179.126004:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065522176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938179.127440:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065522176:12345-0@lo:400:kworker.0 Request processed in 1429us (4524us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938179.127469:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1784938179.130246:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065522816:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.130266:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee236680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065522176:0@lo:400:kworker.0 00010000:00010000:2.0:1784938179.441862:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938179.509060:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938179.509123:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938179.509246:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048735360 00000100:00100000:1.0:1784938179.509261:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048735360 00000100:00100000:1.0:1784938179.509342:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:1.0:1784938179.509355:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:2355:x1871643048735360:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.509466:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:2355:x1871643048735360:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 112us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938179.509497:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:0.0:1784938179.509664:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938179.509699:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938179.509979:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048735232 00000100:00100000:3.0:1784938179.509986:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048735232 00000100:00100000:3.0:1784938179.510032:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 290 00000100:00100000:3.0:1784938179.510041:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048735232:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938179.510095:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048735232:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 55us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938179.510103:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 290 00000100:00100000:0.0:1784938179.510655:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938179.510723:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048735744 00000100:00100000:3.0:1784938179.510730:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048735744 00000100:00100000:3.0:1784938179.510802:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:3.0:1784938179.510823:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048735744:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938179.510868:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048735744:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 46us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938179.510876:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00080000:0.0:1784938179.511299:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938179.511433:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048735616 00000100:00100000:2.0:1784938179.511440:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048735616 00000100:00100000:2.0:1784938179.511535:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048735488 00000100:00100000:2.0:1784938179.511538:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048735488 00000100:00100000:1.0:1784938179.511573:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:1.0:1784938179.511585:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048735616:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938179.511638:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048735616:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 56us (2514us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938179.511646:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00080000:0.0:1784938179.512011:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938179.512061:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938179.512319:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:2.0:1784938179.512330:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048735488:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938179.512374:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048735488:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 47us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938179.512381:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:0.0:1784938179.633586:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:2.0:1784938179.633654:0:7842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 388576437240ns, next at 389576433889ns, rc = 0 00000100:00100000:0.0:1784938179.635549:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065522944:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938179.636941:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938179.640622:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065522944 00000100:00100000:2.0:1784938179.640644:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065522944 00000100:00100000:2.0:1784938179.640723:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00100000:2.0:1784938179.640733:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871643065522944:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938179.640790:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938179.642849:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff871c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871643065522944:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 2104us (5904us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938179.642867:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00100000:2.0:1784938179.648875:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8228700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065522944:192.168.201.158@tcp:13:osp-pre-1-0.0 00000040:00080000:0.0:1784938180.089932:0:12022:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938180.089947:0:12022:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938180.089998:0:12022:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1784938180.090005:0:12022:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938180.289427:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938180.289479:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736000 00000100:00100000:1.0:1784938180.289492:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736000 00000100:00100000:1.0:1784938180.289572:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:1.0:1784938180.289584:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:10553:x1871643048736000:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784938180.289612:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938180.289641:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4006 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a54 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938180.290439:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec400d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938180.290461:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec400d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938180.290477:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec400d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938180.290491:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1784938180.290655:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4006 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a54 expref: 27 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938180.292045:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec400d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a54 expref: 26 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938180.292057:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938180.292060:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784938180.292065:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990200, rc 0) 00000100:00100000:1.0:1784938180.292158:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10553:x1871643048736000:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2574us (2745us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1784938180.292170:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00080000:1.0:1784938180.293330:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938180.302590:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938180.302631:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736128 00000100:00100000:3.0:1784938180.302642:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736128 00000100:00100000:3.0:1784938180.302839:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:3.0:1784938180.302851:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10553:x1871643048736128:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784938180.302937:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.302960:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.302975:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303015:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303021:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303029:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303035:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938180.303040:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303060:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303074:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:3.0:1784938180.303078:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938180.303084:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938180.303090:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec401b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938180.303181:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff870a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:10553:x1871643048736128:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 332us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938180.303190:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:1.0:1784938180.413502:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938180.414532:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736256 00000100:00100000:0.0:1784938180.414551:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736256 00000100:00100000:0.0:1784938180.414644:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:0.0:1784938180.414658:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2358:x1871643048736256:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784938180.414694:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938180.414724:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec4022 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a5b expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938180.414758:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a63fec1, atime: 0x6a63fec1, ctime: 0x6a63fec1, blocks: 0xb 00010000:00010000:0.0:1784938180.414799:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=389s v=(0 0) 00010000:00010000:0.0:1784938180.414804:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938180.414817:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec4022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a5b expref: 7 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938180.414866:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec4022 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a5b expref: 7 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938180.414883:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938180.414970:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2358:x1871643048736256:12345-192.168.201.58@tcp:101:cat.0 Request processed in 316us (1491us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938180.414977:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:3.0:1784938180.427958:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938180.428085:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736384 00000100:00100000:2.0:1784938180.428103:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736384 00002000:00100000:2.0:1784938180.428182:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa05aff870000 x1871643048736384/t0(0) o3->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:411/0 lens 488/0 e 0 to 0 dl 1784938191 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938180.428195:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff870000 with x1871643048736384 ext(0->4095) 00002000:00010000:2.0:1784938180.428202:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aff870000 00000100:00100000:2.0:1784938180.428300:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1784938180.428331:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2357:x1871643048736384:12345-192.168.201.58@tcp:3:cat.0 00000100:00100000:2.0:1784938180.428638:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff870000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2357:x1871643048736384:12345-192.168.201.58@tcp:3:cat.0 Request processed in 308us (692us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1784938180.428648:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00002000:00100000:2.0:1784938180.428658:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffffa05aff870000 x1871643048736384/t0(0) o3->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:411/0 lens 488/4536 e 0 to 0 dl 1784938191 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1784938180.428681:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff870000 with x1871643048736384 ext(0->4095) 00002000:00010000:2.0:1784938180.428685:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aff870000 00010000:00010000:0.0:1784938180.465815:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1784938181.246034:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1784938181.246074:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1784938181.246081:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1784938181.489371:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938182.193545:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938182.193580:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065523072:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938182.194030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938182.194160:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523072 00000100:00100000:1.0:1784938182.194171:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523072 00000100:00100000:1.0:1784938182.194284:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 66 00000100:00100000:1.0:1784938182.194297:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065523072:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938182.194396:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938182.194457:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065523072:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 163us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938182.194465:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 66 00000100:00080000:2.0:1784938182.194760:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938182.195144:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1784938182.195154:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1784938182.195184:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aff873100, transno 4294967304 00000100:00100000:1.0:1784938182.195239:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff873800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065523072:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:00080000:3.0:1784938182.230385:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000001:00080000:3.0:1784938182.230413:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000004:00080000:3.0:1784938182.230434:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1784938182.230469:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05ac5104180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1784938182.230475:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ac4fc8900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05ac5104b40 00000020:00080000:3.0:1784938182.230478:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ac4fc8500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05afbe16000 00000020:00080000:3.0:1784938182.230517:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1784938182.230621:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1784938182.230922:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1784938182.231080:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938182.232680:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065523200:192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00100000:2.0:1784938182.233618:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938182.233703:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523200 00000100:00100000:0.0:1784938182.233715:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523200 00000100:00100000:0.0:1784938182.233805:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 46 00000100:00100000:0.0:1784938182.233827:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3324:x1871643065523200:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 00002000:00010000:0.0:1784938182.234096:0:6604:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1784938182.234100:0:6604:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1784938177 -> 1784938177 00002000:00010000:0.0:1784938182.234102:0:6604:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1784938177 -> 1784938177 00002000:00010000:0.0:1784938182.234104:0:6604:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1784938177 -> 1784938177 00002000:00010000:0.0:1784938182.234106:0:6604:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00080000:1.0:1784938182.238074:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938182.238680:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3324:x1871643065523200:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 Request processed in 4851us (5054us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1784938182.238726:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 46 00000004:00080000:0.0:1784938182.239504:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05ac822aa00/2, rc 0, transno 4294967312 00000100:00100000:0.0:1784938182.239518:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065523200:192.168.201.158@tcp:2:osp-syn-1-0.0 00010000:00010000:3.0:1784938182.514992:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1784938182.736459:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:3.0:1784938182.736481:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00010000:00010000:2.0:1784938183.538149:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938184.241508:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065523328:0@lo:400:kworker.0 00000100:00100000:1.0:1784938184.241590:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938184.241655:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065523840:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938184.241670:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065523712:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938184.241831:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065523456:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.242683:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523328 00000100:00100000:3.0:1784938184.242692:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523328 00000100:00100000:3.0:1784938184.242755:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784938184.242779:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065523328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938184.242801:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065523584:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.243118:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac872bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065523328:12345-0@lo:400:kworker.0 Request processed in 339us (1525us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938184.243125:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1784938184.243190:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938184.243234:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523584 00000100:00100000:3.0:1784938184.243239:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523584 00000100:00100000:3.0:1784938184.243286:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 148 00000100:00100000:3.0:1784938184.243294:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065523584:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938184.243428:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065523968:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.243726:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff873100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065523584:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 430us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938184.243735:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 148 00000100:00080000:1.0:1784938184.243772:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938184.243817:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee075500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065523328:0@lo:400:kworker.0 00000100:00100000:0.0:1784938184.257582:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938184.257622:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938184.257659:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523840 00000100:00100000:0.0:1784938184.257669:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523840 00000100:00100000:0.0:1784938184.257748:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 149 00000100:00100000:0.0:1784938184.257760:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065523840:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938184.257828:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065523840:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 70us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938184.257836:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 149 00000100:00100000:0.0:1784938184.257862:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523712 00000100:00100000:0.0:1784938184.257866:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523712 00000100:00100000:0.0:1784938184.257897:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 81 00000100:00100000:0.0:1784938184.257904:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065523712:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938184.257936:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065523712:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938184.257944:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 81 00000100:00080000:0.0:1784938184.257961:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1784938184.257966:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938184.272346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938184.272397:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938184.272465:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523456 00000100:00100000:2.0:1784938184.272473:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523456 00000100:00100000:2.0:1784938184.272792:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 150 00000100:00100000:2.0:1784938184.272803:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065523456:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938184.272900:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065523456:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 98us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938184.272908:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 150 00000100:00100000:2.0:1784938184.272964:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065523584:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938184.272997:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065523968 00000100:00100000:2.0:1784938184.273000:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065523968 00000100:00100000:2.0:1784938184.273055:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 82 00000100:00100000:2.0:1784938184.273062:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065523968:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938184.273092:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065523968:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 31us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938184.273099:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 82 00000100:00080000:2.0:1784938184.273392:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938184.273417:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065523456:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938184.273429:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1784938184.273435:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aff871f80, transno 4294967309 00000004:00080000:2.0:1784938184.273447:0:3321:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967312 00000004:00080000:2.0:1784938184.273461:0:3321:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05ac822aa00, transno 4294967312 00000100:00100000:2.0:1784938184.273466:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065523968:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938184.274401:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065523712:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938184.274441:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065523840:192.168.201.158@tcp:400:kworker.0 00010000:00010000:3.0:1784938184.561540:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938184.630907:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938184.631009:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938184.631043:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938184.631065:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938184.631101:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938184.631134:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736768 00000100:00100000:3.0:1784938184.631143:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736768 00000100:00100000:3.0:1784938184.631234:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736896 00000100:00100000:3.0:1784938184.631238:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736896 00000100:00100000:3.0:1784938184.631263:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:3.0:1784938184.631273:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048736768:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.631348:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff873800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048736768:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 76us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938184.631361:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:3.0:1784938184.631385:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1784938184.631392:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048736896:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.631419:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048736896:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938184.631426:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1784938184.631445:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737024 00000100:00100000:3.0:1784938184.631449:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737024 00000100:00100000:3.0:1784938184.631476:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736640 00000100:00100000:3.0:1784938184.631479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736640 00000100:00100000:3.0:1784938184.631498:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:3.0:1784938184.631505:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048737024:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.631534:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff871f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048737024:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938184.631541:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:3.0:1784938184.631553:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:3.0:1784938184.631559:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2355:x1871643048736640:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938184.631582:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2355:x1871643048736640:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938184.631588:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:1.0:1784938184.632158:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048736512 00000100:00100000:1.0:1784938184.632164:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048736512 00000100:00100000:1.0:1784938184.632270:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 292 00000100:00100000:1.0:1784938184.632279:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048736512:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:2.0:1784938184.632290:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1784938184.632295:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938184.632298:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938184.632311:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048736512:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 34us (1418us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938184.632318:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 292 00000040:00080000:3.0:1784938184.689455:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938184.689467:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938184.690092:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1784938184.690101:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1784938184.755072:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938184.755098:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065524096:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938184.755404:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938184.755445:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524096 00000100:00100000:1.0:1784938184.755453:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524096 00000100:00100000:1.0:1784938184.755498:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 67 00000100:00100000:1.0:1784938184.755507:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065524096:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938184.755545:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938184.755586:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065524096:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 80us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938184.755593:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 67 00000100:00100000:1.0:1784938184.755724:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065524096:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938185.216334:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938185.216426:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737152 00000100:00100000:3.0:1784938185.216436:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737152 00000100:00100000:3.0:1784938185.216507:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:3.0:1784938185.216528:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10198:x1871643048737152:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784938185.216866:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10198:x1871643048737152:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 Request processed in 339us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938185.216874:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:1.0:1784938185.222994:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938185.223086:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737408 00000100:00100000:0.0:1784938185.223107:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737408 00000100:00100000:0.0:1784938185.223171:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784938185.223181:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:10198:x1871643048737408:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1784938185.224188:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:10198:x1871643048737408:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1003us (1198us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1784938185.224198:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1784938185.544757:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938185.547365:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737536 00000100:00100000:2.0:1784938185.547383:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737536 00000100:00100000:2.0:1784938185.547543:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:2.0:1784938185.547555:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:11006:x1871643048737536:12345-192.168.201.58@tcp:101:lsof.0 00010000:00010000:2.0:1784938185.547577:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938185.547600:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a62 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938185.547672:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938185.547695:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938185.547724:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938185.548019:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938185.548024:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938185.548191:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938185.548977:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 7 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938185.549003:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 6 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938185.549012:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:2.0:1784938185.549014:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938185.549018:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938185.549267:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:11006:x1871643048737536:12345-192.168.201.58@tcp:101:lsof.0 Request processed in 1713us (4519us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938185.549276:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00010000:00010000:2.0:1784938185.586010:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938186.609470:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938187.314491:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938187.314518:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065524224:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938187.316478:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938187.316514:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524224 00000100:00100000:1.0:1784938187.316523:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524224 00000100:00100000:1.0:1784938187.316583:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 68 00000100:00100000:1.0:1784938187.316594:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065524224:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938187.316631:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938187.316696:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4dfbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065524224:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938187.316703:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 68 00000100:00080000:1.0:1784938187.317466:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938187.317609:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee236a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065524224:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:00080000:3.0:1784938187.390434:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1784938187.390457:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1784938187.393283:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1784938187.393306:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1784938187.633452:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938188.525928:0:12222:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 20:09:48 (1784938188) 00010000:00010000:0.0:1784938188.657928:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938189.363328:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065524608:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.363478:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784938189.363487:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065524480:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.363521:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065524992:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938189.363820:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065524352:0@lo:400:kworker.0 00000100:00100000:3.0:1784938189.363879:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938189.363906:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065524736:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938189.363914:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065524864:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.364209:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938189.364308:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938189.364355:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938189.364375:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938189.364397:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938189.364428:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524480 00000100:00100000:1.0:1784938189.364436:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524480 00000100:00100000:1.0:1784938189.364488:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524608 00000100:00100000:1.0:1784938189.364491:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524608 00000100:00100000:1.0:1784938189.364516:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524864 00000100:00100000:1.0:1784938189.364518:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524864 00000100:00100000:1.0:1784938189.364538:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 153 00000100:00100000:1.0:1784938189.364547:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065524480:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.364605:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065524480:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 58us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938189.364626:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 153 00000100:00100000:1.0:1784938189.364646:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 154 00000100:00100000:1.0:1784938189.364653:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065524608:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.364677:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065524608:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938189.364683:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 154 00000100:00100000:1.0:1784938189.364726:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 155 00000100:00100000:1.0:1784938189.364733:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065524864:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.364757:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065524864:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938189.366121:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 155 00000100:00100000:1.0:1784938189.366184:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524736 00000100:00100000:1.0:1784938189.366192:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524736 00000100:00100000:1.0:1784938189.366278:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524992 00000100:00100000:1.0:1784938189.366282:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524992 00000100:00100000:1.0:1784938189.366304:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 85 00000100:00100000:1.0:1784938189.366313:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065524736:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.366384:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065524736:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 72us (2075us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938189.366392:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 85 00000100:00100000:1.0:1784938189.366404:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 86 00000100:00100000:1.0:1784938189.366410:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065524992:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938189.366438:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065524992:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938189.366443:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 86 00000100:00080000:1.0:1784938189.366478:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938189.366482:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938189.366485:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938189.370422:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff883800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065524480:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938189.370447:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff881500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065524608:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938189.374016:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065524352 00000100:00100000:3.0:1784938189.374036:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065524352 00000100:00100000:3.0:1784938189.374125:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1784938189.374138:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065524352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938189.383800:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065524992:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938189.386336:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065524736:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938189.394272:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065524352:12345-0@lo:400:kworker.0 Request processed in 20122us (30379us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938189.394293:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1784938189.394633:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff881c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065524352:0@lo:400:kworker.0 00000100:00100000:2.0:1784938189.394684:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeb0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065524864:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938189.682477:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938189.751781:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938189.751845:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938189.751879:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938189.751916:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938189.751965:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737920 00000100:00100000:3.0:1784938189.751980:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737920 00000100:00100000:0.0:1784938189.752072:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737664 00000100:00100000:3.0:1784938189.752074:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784938189.752084:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737664 00000100:00100000:3.0:1784938189.752093:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048737920:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938189.752146:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 294 00000100:00100000:0.0:1784938189.752158:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048737664:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938189.752194:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2357:x1871643048737920:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 105us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938189.752269:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048737664:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 111us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938189.752276:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784938189.752287:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 294 00000100:00080000:3.0:1784938189.752351:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938189.752648:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938189.752727:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048738176 00000100:00100000:3.0:1784938189.752734:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048738176 00000100:00100000:3.0:1784938189.752780:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048737792 00000100:00100000:3.0:1784938189.752783:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048737792 00000100:00100000:3.0:1784938189.752804:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:3.0:1784938189.752811:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2357:x1871643048738176:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938189.752964:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff871c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2357:x1871643048738176:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 152us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938189.752972:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:3.0:1784938189.752986:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:3.0:1784938189.752994:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2357:x1871643048737792:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:1.0:1784938189.753010:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938189.753038:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2357:x1871643048737792:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 43us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938189.753047:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:0.0:1784938189.753155:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048738048 00000100:00100000:0.0:1784938189.753164:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048738048 00000100:00100000:0.0:1784938189.753266:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784938189.753278:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048738048:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938189.753333:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2357:x1871643048738048:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 59us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938189.753353:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00080000:1.0:1784938189.753738:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938189.875002:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065525120:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938189.875385:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938189.875528:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065525120 00000100:00100000:3.0:1784938189.875544:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065525120 00000100:00100000:3.0:1784938189.876122:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 69 00000100:00100000:3.0:1784938189.876136:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065525120:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938189.876187:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938189.876321:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065525120:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 188us (936us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938189.876329:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 69 00000100:00100000:0.0:1784938189.876675:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065525120:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938189.893261:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938189.893365:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048738432 00000100:00100000:1.0:1784938189.893378:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048738432 00000100:00100000:1.0:1784938189.893451:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:1.0:1784938189.893471:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:11271:x1871643048738432:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938189.893499:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938189.893529:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4037 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a69 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.893639:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.893658:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.893671:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.893688:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.893695:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.893701:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.894691:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec404c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.894716:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec404c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.894725:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec404c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938189.894738:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784938189.895797:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895813:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895822:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895828:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938189.895834:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895843:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895860:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa05ad886b000) 00010000:00010000:1.0:1784938189.895864:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938189.895869:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895875:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991a00/0xea86628a8aec403e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895891:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895912:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895917:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.895922:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938189.896003:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.896011:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.896020:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa05ac7d1dc00) 00010000:00010000:1.0:1784938189.896022:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938189.896026:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.896031:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4045 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.896578:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4037 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a69 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.896597:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec404c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a69 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.896622:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:1.0:1784938189.896625:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938189.896635:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990400, rc 0) 00000100:00100000:1.0:1784938189.896731:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:11271:x1871643048738432:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 3268us (3512us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1784938189.896741:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:2.0:1784938189.904473:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938189.905054:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048738560 00000100:00100000:0.0:1784938189.905068:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048738560 00000100:00100000:0.0:1784938189.905147:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:0.0:1784938189.905160:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:11271:x1871643048738560:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1784938189.905343:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:11271:x1871643048738560:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 185us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938189.905352:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:3.0:1784938189.910868:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938189.911317:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048738688 00000100:00100000:1.0:1784938189.911330:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048738688 00000100:00100000:1.0:1784938189.911418:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938189.911430:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:2358:x1871643048738688:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938189.911451:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938189.911497:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec404c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a69 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938189.911521:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:1.0:1784938189.911527:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938189.911709:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2358:x1871643048738688:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 280us (854us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938189.911718:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00010000:00010000:0.0:1784938190.715909:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938190.836935:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938190.836949:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938190.839201:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1784938190.840348:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1784938191.735329:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938192.245398:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.245489:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048738816 00000100:00100000:0.0:1784938192.245503:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048738816 00000100:00100000:0.0:1784938192.245619:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:0.0:1784938192.245633:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:11313:x1871643048738816:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.245663:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.245694:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec405a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a70 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.245782:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.245800:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.245816:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.245842:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.245850:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.245857:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246180:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246190:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246197:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246204:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.246210:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246259:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246275:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:0.0:1784938192.246278:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.246284:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246291:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4061 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246312:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246318:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246323:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246328:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.246331:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246337:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246345:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938192.246348:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.246350:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246356:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4068 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246393:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec405a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a70 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246404:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:0.0:1784938192.246407:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.246416:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec405a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a70 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.246426:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031400, rc 0) 00000100:00100000:0.0:1784938192.246503:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:11313:x1871643048738816:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 874us (1119us total) trans 0 rc 301/301 00000100:00100000:0.0:1784938192.246512:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00080000:2.0:1784938192.247127:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938192.252140:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.253310:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739072 00000100:00100000:0.0:1784938192.253327:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739072 00000100:00100000:0.0:1784938192.253402:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00100000:0.0:1784938192.253413:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:11313:x1871643048739072:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:0.0:1784938192.253489:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938192.253527:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec39d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978a9 expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.253546:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:0.0:1784938192.253554:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938192.254518:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.254544:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 5 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.254556:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.254755:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 5 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.254777:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 5 pid: 7211 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.254798:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065525248:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938192.254976:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac6860000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938192.274095:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.274137:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739200 00000100:00100000:2.0:1784938192.274149:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739200 00010000:00010000:2.0:1784938192.274211:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 6 pid: 7211 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938192.274276:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1784938192.274290:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2355:x1871643048739200:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938192.274312:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938192.274320:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 6 pid: 7211 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.274335:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 6 pid: 7211 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.274363:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:2.0:1784938192.274369:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.274381:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.274400:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.274424:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938192.274491:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2355:x1871643048739200:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 204us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938192.274500:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00080000:2.0:1784938192.274543:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1784938192.274804:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4030 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a62 expref: 5 pid: 7211 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938192.274822:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065525248:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938192.274848:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.274858:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.274864:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.274895:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.274918:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.274926:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938192.276278:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1784938192.276294:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.276303:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.276312:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.276330:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938192.276337:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.276347:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.276363:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ac3861b00) 00010000:00010000:3.0:1784938192.276367:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938192.276373:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.276380:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec406f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938192.276400:0:5806:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e4966d61 reply state 000000005a1cab14 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938192.276411:0:5806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938192.276528:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:11313:x1871643048739072:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 23114us (24402us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1784938192.276539:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 140 00010000:00010000:3.0:1784938192.282043:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.282063:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.282071:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.282099:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938192.282105:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.282113:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.282134:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa05ac3861000) 00010000:00010000:3.0:1784938192.282138:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938192.282143:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.282150:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4076 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938192.376711:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.376785:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739328 00000100:00100000:2.0:1784938192.376799:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739328 00000100:00100000:2.0:1784938192.376868:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:2.0:1784938192.376880:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:11321:x1871643048739328:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:2.0:1784938192.376916:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938192.376946:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec407d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a77 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.377030:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.377047:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.377061:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938192.377137:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938192.377141:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938192.377172:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.377210:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec407d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a77 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.377258:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a77 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.377267:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938192.377271:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938192.377275:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892200, rc 0) 00000100:00100000:2.0:1784938192.377347:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8228700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:11321:x1871643048739328:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 470us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938192.377355:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:2.0:1784938192.435777:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065525376:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938192.436324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938192.444716:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065525376 00000100:00100000:0.0:1784938192.444735:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065525376 00000100:00100000:0.0:1784938192.444825:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 70 00000100:00100000:0.0:1784938192.444839:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065525376:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938192.444882:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938192.444983:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065525376:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 145us (8657us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.444993:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 70 00000100:00100000:0.0:1784938192.445311:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee234000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065525376:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:3.0:1784938192.445582:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938192.458091:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.459337:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739456 00000100:00100000:0.0:1784938192.459355:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739456 00000100:00100000:0.0:1784938192.459431:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:0.0:1784938192.459443:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+15:11327:x1871643048739456:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938192.459596:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.459627:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec408b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a7e expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.459730:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.459749:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.459764:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.459781:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.459789:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.459796:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.460716:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec40a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.460733:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec40a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.460759:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec40a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938192.460869:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784938192.462587:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938192.463344:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec40a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463373:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463381:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463391:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463397:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.463405:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463414:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463440:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938192.463444:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.463451:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463458:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463497:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463503:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463509:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463514:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.463516:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463522:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463530:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938192.463532:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.463534:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463540:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463603:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec408b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a7e expref: 17 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463620:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec40a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a7e expref: 16 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.463812:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938192.463815:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1784938192.463819:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b400, rc 0) 00000100:00100000:0.0:1784938192.464046:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:11327:x1871643048739456:12345-192.168.201.58@tcp:101:bash.0 Request processed in 4602us (5962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.464057:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:0.0:1784938192.467752:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.467843:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739712 00000100:00100000:2.0:1784938192.467855:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739712 00000100:00100000:2.0:1784938192.467940:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 143 00000100:00100000:2.0:1784938192.467952:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+16:11327:x1871643048739712:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938192.467982:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938192.468010:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec40a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a85 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.469479:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.469504:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.469528:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.471121:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.471155:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.471169:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938192.472467:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1784938192.477187:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477212:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477245:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477287:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477295:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477302:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477308:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938192.477324:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477332:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477344:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938192.477347:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938192.477351:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477358:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec40ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938192.477372:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e2dee05f reply state 00000000762976f0 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938192.477380:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938192.477418:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec40a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477433:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.477441:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:2.0:1784938192.477444:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938192.477446:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938192.477545:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11327:x1871643048739712:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9594us (9806us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1784938192.477553:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 143 00010000:00010000:1.0:1784938192.479973:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.479990:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.479998:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.480004:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938192.480009:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.480017:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.480032:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b300) 00010000:00010000:1.0:1784938192.480036:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938192.480041:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.480063:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec40b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938192.481029:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938192.485523:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739840 00000100:00100000:1.0:1784938192.485541:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739840 00000100:00100000:1.0:1784938192.485742:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1784938192.485754:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048739840:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1784938192.485776:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938192.485801:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a8c expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938192.485832:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938192.485855:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=401s v=(0 0) 00010000:00010000:1.0:1784938192.485860:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938192.485871:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.485891:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 6 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.485906:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990800, rc 0) 00000100:00100000:1.0:1784938192.485974:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048739840:12345-192.168.201.58@tcp:101:bash.0 Request processed in 222us (4949us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938192.485982:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00080000:3.0:1784938192.486053:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938192.498471:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.498563:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048739968 00000100:00100000:0.0:1784938192.498574:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048739968 00000100:00100000:0.0:1784938192.498770:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784938192.498784:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:11327:x1871643048739968:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938192.498803:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.498825:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a93 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.498855:0:6605:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.498864:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938192.498869:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938192.498873:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.498905:0:6605:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 7 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.498933:0:6605:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 7 pid: 6602 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938192.498948:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1871643065525504:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938192.503007:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac879e480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938192.506965:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938192.506999:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048740096 00000100:00100000:1.0:1784938192.507024:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048740096 00010000:00010000:1.0:1784938192.507079:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 8 pid: 6602 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.507121:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:1.0:1784938192.507130:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048740096:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938192.507145:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938192.507169:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 8 pid: 6602 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.507183:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 8 pid: 6602 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.507210:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938192.507239:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938192.507249:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.507259:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.507297:0:5791:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.507314:0:5791:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5791:1871643065525632:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784938192.507391:0:5791:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac88056c0 going to sleep for 11 seconds 00010000:00010000:0.0:1784938192.507701:0:6605:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016bd1b70/0xea86628a8aec40ca lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a8c expref: 8 pid: 6602 timeout: 501 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938192.507717:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6605:1871643065525504:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938192.507742:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 7 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.507752:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031600, rc 0) 00000100:00100000:0.0:1784938192.507797:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:11327:x1871643048739968:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9018us (9336us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.507806:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:1.0:1784938192.510621:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.510751:0:5791:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5791:1871643065525632:192.168.201.58@tcp:105: 00010000:00010000:0.0:1784938192.510783:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938192.510867:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048740096:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 3736us (3910us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.510952:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1784938192.511007:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048740352 00000100:00100000:0.0:1784938192.511016:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048740352 00000100:00100000:0.0:1784938192.511088:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:0.0:1784938192.511097:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11327:x1871643048740352:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1784938192.511958:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11327:x1871643048740352:12345-192.168.201.58@tcp:35:bash.0 Request processed in 856us (1342us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1784938192.511967:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000001:00080000:3.0:1784938192.515094:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000001:00080000:3.0:1784938192.515208:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000100:00100000:1.0:1784938192.590852:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.590983:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048740608 00000100:00100000:0.0:1784938192.590994:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048740608 00000100:00100000:0.0:1784938192.591101:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:0.0:1784938192.591110:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:11337:x1871643048740608:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.591139:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.591162:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec40d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897a9a expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938192.591323:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1784938192.591461:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec40d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a9a expref: 19 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.591475:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938192.591477:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938192.591481:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec40d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a9a expref: 19 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.591493:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031800, rc 0) 00000100:00100000:0.0:1784938192.591567:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11337:x1871643048740608:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 458us (731us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1784938192.591573:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:1.0:1784938192.594868:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.595471:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048740864 00000100:00100000:0.0:1784938192.595502:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048740864 00000100:00100000:0.0:1784938192.595585:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:0.0:1784938192.595597:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11337:x1871643048740864:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938192.596323:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11337:x1871643048740864:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 724us (1461us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1784938192.596334:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:2.0:1784938192.654784:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.655044:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048740992 00000100:00100000:0.0:1784938192.655057:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048740992 00000100:00100000:0.0:1784938192.655168:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:0.0:1784938192.655180:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11343:x1871643048740992:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.655252:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.655283:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec40e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897aa1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.655386:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec40ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.655404:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec40ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.655419:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec40ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938192.655495:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1784938192.655499:0:5805:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938192.655526:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec40ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.655571:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec40e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aa1 expref: 21 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.655616:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec40ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aa1 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.655627:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938192.655630:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938192.655634:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031400, rc 0) 00000100:00100000:0.0:1784938192.655703:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11343:x1871643048740992:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 526us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.655712:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:0.0:1784938192.661378:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938192.662067:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048741248 00000100:00100000:3.0:1784938192.662082:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048741248 00000100:00100000:3.0:1784938192.662204:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:3.0:1784938192.662256:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11343:x1871643048741248:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938192.662285:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938192.662314:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec40f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897aa8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.662473:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec40fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.662489:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec40fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.662502:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec40fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938192.662515:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1784938192.662702:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec40f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aa8 expref: 23 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.662727:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec40fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aa8 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.662737:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:3.0:1784938192.662741:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938192.662745:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d200, rc 0) 00000100:00100000:3.0:1784938192.662829:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:11343:x1871643048741248:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 615us (1465us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1784938192.662838:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:1.0:1784938192.665963:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.666054:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048741376 00000100:00100000:2.0:1784938192.666066:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048741376 00000100:00100000:2.0:1784938192.666154:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938192.666166:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:2358:x1871643048741376:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938192.666186:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938192.666255:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec40fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aa8 expref: 22 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.666278:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:2.0:1784938192.666284:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938192.666362:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2358:x1871643048741376:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 199us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938192.666372:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938192.668164:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.668276:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048741632 00000100:00100000:0.0:1784938192.668287:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048741632 00000100:00100000:0.0:1784938192.668355:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:0.0:1784938192.668367:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:11343:x1871643048741632:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.668398:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.668423:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4109 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897aaf expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.668549:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4110 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.668578:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.668593:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938192.668633:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784938192.668800:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4109 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aaf expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.668823:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aaf expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.668833:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:0.0:1784938192.668836:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784938192.668841:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:0.0:1784938192.668919:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:11343:x1871643048741632:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 555us (765us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1784938192.668928:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:1.0:1784938192.680117:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.680589:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048741760 00000100:00100000:2.0:1784938192.680603:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048741760 00000100:00100000:2.0:1784938192.680683:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784938192.680695:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048741760:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:2.0:1784938192.680756:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.680782:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.680792:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938192.680814:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938192.680820:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.680867:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 6 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.680885:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 6 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938192.680903:0:8127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af52ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1871643065525760:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938192.681032:0:8127:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7da4c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938192.692073:0:8127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af52ba300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1871643065525760:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938192.692120:0:8127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.692493:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.694164:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048741888 00000100:00100000:0.0:1784938192.694183:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048741888 00002000:00100000:0.0:1784938192.694300:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa05afbc7df80 x1871643048741888/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:423/0 lens 504/0 e 0 to 0 dl 1784938203 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938192.694313:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05afbc7df80 with x1871643048741888 ext(0->12) 00010000:00010000:0.0:1784938192.694324:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 7 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.694352:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 7 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938192.694361:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05afbc7df80 00000100:00100000:0.0:1784938192.694403:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784938192.694430:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048741888:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:0.0:1784938192.695260:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2355:x1871643048741888:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 827us (2763us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1784938192.695270:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00002000:00100000:0.0:1784938192.695280:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffffa05afbc7df80 x1871643048741888/t4294967305(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:423/0 lens 504/448 e 0 to 0 dl 1784938203 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938192.695288:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05afbc7df80 with x1871643048741888 ext(0->12) 00010000:00010000:0.0:1784938192.695296:0:6608:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 9 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.695310:0:6608:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 9 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938192.695318:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05afbc7df80 00000100:00100000:3.0:1784938192.707089:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938192.711814:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048742016 00000100:00100000:1.0:1784938192.711835:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048742016 00010000:00010000:1.0:1784938192.713908:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 9 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.713968:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:1.0:1784938192.713986:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2357:x1871643048742016:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938192.714009:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1784938192.714035:0:5792:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784938192.714038:0:5792:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1784938193 00002000:00010000:1.0:1784938192.714040:0:5792:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1784938193 00002000:00010000:1.0:1784938192.714043:0:5792:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1784938193 00010000:00010000:1.0:1784938192.714049:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 9 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.714065:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 9 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.714094:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000922f4f08/0xea86628a8aec40d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a93 expref: 9 pid: 6605 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.714139:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938192.714144:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938192.714151:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.714162:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.714203:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938192.714330:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2357:x1871643048742016:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 353us (7256us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938192.714339:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00010000:00010000:2.0:1784938192.714841:0:8127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714855:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714891:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714901:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714919:0:8127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714927:0:8127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938192.714932:0:8127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714941:0:8127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714955:0:8127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938192.714962:0:8127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec411e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938192.715046:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048741760:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 34351us (34943us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938192.715056:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784938192.718894:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.719334:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048742272 00000100:00100000:0.0:1784938192.719349:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048742272 00000100:00100000:0.0:1784938192.719425:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784938192.719436:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:11343:x1871643048742272:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:0.0:1784938192.719888:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aaf expref: 23 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938192.720452:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1784938192.720748:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1784938192.721465:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1784938192.721559:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.721596:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.721608:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.721785:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 27 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.721807:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 27 pid: 5804 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938192.721828:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1871643065525888:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938192.721944:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac88de000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938192.724626:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938192.724815:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048742400 00000100:00100000:3.0:1784938192.724829:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048742400 00010000:00010000:3.0:1784938192.724881:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 28 pid: 5804 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938192.724953:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1784938192.724964:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:2356:x1871643048742400:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938192.724982:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938192.724990:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 28 pid: 5804 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.725007:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 28 pid: 5804 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.725035:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:3.0:1784938192.725041:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.725053:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.725062:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938192.725086:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938192.725152:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:2356:x1871643048742400:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 188us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938192.725159:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00010000:00010000:1.0:1784938192.725691:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec40bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a85 expref: 27 pid: 5804 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.725714:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1871643065525888:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938192.725739:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.725750:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.725757:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938192.725916:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1784938192.726166:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1784938192.726350:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbc7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065526016:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938192.726427:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8805900 going to sleep for 11 seconds 00000100:00100000:1.0:1784938192.727949:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938192.727992:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065526016 00000100:00100000:1.0:1784938192.728002:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065526016 00000100:00100000:1.0:1784938192.728061:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:1.0:1784938192.728071:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065526016:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938192.728178:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065526016:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 Request processed in 107us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938192.728187:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:1.0:1784938192.728385:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbc7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065526016:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784938192.729010:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:1.0:1784938192.729106:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbc7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065526144:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938192.729170:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac88056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938192.729333:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938192.729358:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065526144 00000100:00100000:1.0:1784938192.729364:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065526144 00000100:00100000:1.0:1784938192.729402:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:1.0:1784938192.729411:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065526144:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1784938192.729594:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5807:x1871643065526144:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 Request processed in 183us (262us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1784938192.729603:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:1.0:1784938192.729719:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbc7ed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065526144:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1784938192.729782:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:1.0:1784938192.729837:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.729850:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.729860:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.729868:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938192.729874:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.729884:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.729903:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:1.0:1784938192.729907:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1784938192.729913:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938192.729920:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4125 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1784938192.730109:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1784938192.730267:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:1.0:1784938192.730280:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 401673063821ns, next at 402673061766ns, rc = 0 00000001:00080000:1.0:1784938192.730287:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1784938192.730318:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bb00) 00010000:00010000:1.0:1784938192.730321:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1784938192.730327:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4110 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aaf expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938192.730439:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:11343:x1871643048742272:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 11004us (11571us total) trans 4294967431 rc 0/0 00000100:00100000:1.0:1784938192.730449:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000020:00080000:1.0:1784938192.730453:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1784938192.743519:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.745844:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048742528 00000100:00100000:0.0:1784938192.745862:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048742528 00000100:00100000:0.0:1784938192.745948:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:0.0:1784938192.745961:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+30:11343:x1871643048742528:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.745996:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.746034:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec412c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ab6 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.746118:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec412c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ab6 expref: 31 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.746136:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec412c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ab6 expref: 31 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.746176:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938192.746179:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938192.746182:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a000, rc 0) 00000100:00100000:0.0:1784938192.746958:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:11343:x1871643048742528:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 995us (3449us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.746967:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:1.0:1784938192.750389:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.750481:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048742784 00000100:00100000:2.0:1784938192.750495:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048742784 00000100:00100000:2.0:1784938192.750573:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1784938192.750584:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:11343:x1871643048742784:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938192.750925:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11343:x1871643048742784:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 341us (545us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1784938192.750933:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00010000:00010000:0.0:1784938192.754467:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938192.817429:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.817580:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048743040 00000100:00100000:0.0:1784938192.817594:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048743040 00000100:00100000:0.0:1784938192.817689:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:0.0:1784938192.817701:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11353:x1871643048743040:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.817733:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.817762:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897abd expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938192.817907:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1784938192.818057:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4133 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897abd expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.818071:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938192.818074:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938192.818078:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897abd expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.818094:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:0.0:1784938192.818159:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:11353:x1871643048743040:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 462us (743us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1784938192.818181:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:3.0:1784938192.820576:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.820670:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048743168 00000100:00100000:0.0:1784938192.820682:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048743168 00000100:00100000:0.0:1784938192.820761:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:0.0:1784938192.820773:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:11353:x1871643048743168:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:0.0:1784938192.820876:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.820898:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.820913:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.820933:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.820941:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.820948:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821069:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821078:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821085:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938192.821153:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821167:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821174:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821181:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821187:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.821191:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821199:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821254:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938192.821258:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.821264:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821271:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4141 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821287:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821293:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821305:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821311:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.821314:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821321:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821329:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac30f8700) 00010000:00010000:0.0:1784938192.821332:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.821335:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821342:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec4148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821359:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821365:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821371:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821376:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.821378:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821395:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821404:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938192.821406:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.821410:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.821415:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec414f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938192.821510:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff836d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:11353:x1871643048743168:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 739us (960us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.821520:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:1.0:1784938192.823346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.823435:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048743424 00000100:00100000:2.0:1784938192.823447:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048743424 00000100:00100000:2.0:1784938192.823517:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:2.0:1784938192.823528:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+33:11353:x1871643048743424:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938192.823842:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:11353:x1871643048743424:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 315us (506us total) trans 4294967434 rc 0/0 00000100:00100000:2.0:1784938192.823851:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:1.0:1784938192.851930:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.852003:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048743680 00000100:00100000:0.0:1784938192.852017:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048743680 00000100:00100000:0.0:1784938192.852096:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:0.0:1784938192.852109:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:11356:x1871643048743680:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938192.852143:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938192.852171:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ac4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852296:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852314:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852329:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852370:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852376:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852380:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852518:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852524:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852528:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938192.852536:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784938192.852662:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852669:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852677:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852683:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.852688:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852706:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852720:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938192.852724:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.852731:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852737:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031600/0xea86628a8aec415d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852752:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852759:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852765:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852771:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11b000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.852774:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852780:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852787:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac30f8700) 00010000:00010000:0.0:1784938192.852790:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938192.852793:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852809:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852855:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852866:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.852872:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938192.852874:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938192.852876:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:0.0:1784938192.852945:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:11356:x1871643048743680:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 839us (1030us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1784938192.852954:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:2.0:1784938192.858974:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938192.859128:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048743808 00000100:00100000:0.0:1784938192.859141:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048743808 00000100:00100000:0.0:1784938192.859255:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:0.0:1784938192.859267:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:11356:x1871643048743808:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1784938192.859441:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859463:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859475:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859530:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859538:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859545:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859626:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ee200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938192.859631:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859641:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859656:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938192.859659:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938192.859664:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938192.859671:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938192.859828:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:11356:x1871643048743808:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 561us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938192.859838:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:1.0:1784938192.861905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938192.861987:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048744064 00000100:00100000:2.0:1784938192.861999:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048744064 00000100:00100000:2.0:1784938192.862057:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:2.0:1784938192.862066:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:11356:x1871643048744064:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938192.862372:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:11356:x1871643048744064:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 306us (481us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1784938192.862377:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784938193.044306:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.044471:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048744320 00000100:00100000:0.0:1784938193.044485:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048744320 00000100:00100000:0.0:1784938193.044887:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:0.0:1784938193.044923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:11387:x1871643048744320:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784938193.044957:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938193.044988:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897acb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.045135:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.045154:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.045168:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938193.045182:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1784938193.045379:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897acb expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.045404:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897acb expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.045413:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938193.045417:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938193.045421:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05b021ee800, rc 0) 00000100:00100000:0.0:1784938193.045508:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11387:x1871643048744320:12345-192.168.201.58@tcp:101:cat.0 Request processed in 588us (1215us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1784938193.045517:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:2.0:1784938193.050885:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938193.050982:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938193.051076:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048744704 00000100:00100000:1.0:1784938193.051089:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048744704 00000100:00100000:1.0:1784938193.051183:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1784938193.051197:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:2358:x1871643048744704:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938193.051251:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938193.051285:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897acb expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.051309:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:1.0:1784938193.051316:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938193.051390:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:2358:x1871643048744704:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 197us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938193.051399:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784938193.053155:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048744576 00000100:00100000:0.0:1784938193.053173:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048744576 00000100:00100000:0.0:1784938193.053422:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784938193.053434:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:11387:x1871643048744576:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1784938193.053824:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11387:x1871643048744576:12345-192.168.201.58@tcp:35:cat.0 Request processed in 391us (2953us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1784938193.053833:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1784938193.118008:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.118133:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048744960 00000100:00100000:0.0:1784938193.118146:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048744960 00000100:00100000:0.0:1784938193.118274:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:0.0:1784938193.118287:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11393:x1871643048744960:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1784938193.118320:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938193.118325:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938193.118363:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec40ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aa1 expref: 39 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.118390:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938193.118397:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938193.118415:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4195 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ad2 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.118562:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.118578:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.118589:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.118788:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.118804:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 39 pid: 5804 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938193.118820:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065526272:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938193.118937:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac879e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938193.122484:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065526272:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938193.122529:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.123905:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938193.124184:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048745088 00000100:00100000:3.0:1784938193.124197:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048745088 00010000:00010000:3.0:1784938193.124286:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 40 pid: 5804 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938193.124349:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1784938193.124361:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+40:2356:x1871643048745088:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938193.124379:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938193.124388:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 40 pid: 5804 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.124403:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 40 pid: 5804 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.124429:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec416b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ac4 expref: 40 pid: 5804 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.124453:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:3.0:1784938193.124460:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.124473:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.124484:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.124525:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938193.124605:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:2356:x1871643048745088:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 245us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938193.124613:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00010000:00010000:2.0:1784938193.124790:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.124812:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938193.124835:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1784938193.125032:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4195 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 41 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.125051:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 40 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.125059:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:2.0:1784938193.125062:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938193.125064:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05b021ee800, rc 0) 00000100:00100000:2.0:1784938193.125095:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+40:11393:x1871643048744960:12345-192.168.201.58@tcp:101:dd.0 Request processed in 6812us (7103us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1784938193.125103:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:2.0:1784938193.134571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.134794:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048745344 00000100:00100000:0.0:1784938193.134809:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048745344 00000100:00100000:0.0:1784938193.134886:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 155 00000100:00100000:0.0:1784938193.134898:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11393:x1871643048745344:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1784938193.135311:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.135333:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.135346:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938193.135407:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1784938193.135435:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009426f181 reply state 000000001012c363 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938193.135465:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938193.135593:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+42:11393:x1871643048745344:12345-192.168.201.58@tcp:36:dd.0 Request processed in 696us (1050us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1784938193.135601:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 155 00000020:00080000:0.0:1784938193.135618:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784938193.142807:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.142850:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.142860:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.142867:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ee200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938193.142874:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.142884:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.142906:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:3.0:1784938193.142910:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938193.142915:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.142923:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec41aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.424040:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938193.424323:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048745472 00000100:00100000:3.0:1784938193.424338:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048745472 00000100:00100000:3.0:1784938193.424415:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:3.0:1784938193.424427:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+41:11408:x1871643048745472:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:3.0:1784938193.424463:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938193.424491:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec41b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ad9 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.424849:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.424883:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.424897:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.424913:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.424921:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.424927:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.425043:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.425055:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 42 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.425064:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.425106:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 42 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.425123:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 42 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938193.425152:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065526400:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938193.425439:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aded6fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938193.431709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938193.432094:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065526400:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938193.432132:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.432200:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048745728 00000100:00100000:2.0:1784938193.432293:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048745728 00000100:00100000:2.0:1784938193.432427:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1784938193.432439:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+43:5570:x1871643048745728:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1784938193.432914:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:5570:x1871643048745728:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 474us (1389us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1784938193.432923:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784938193.438507:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938193.438749:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048745856 00000100:00100000:3.0:1784938193.438763:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048745856 00010000:00010000:3.0:1784938193.438821:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 44 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938193.438880:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:3.0:1784938193.438894:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:2356:x1871643048745856:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938193.438913:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938193.438922:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 44 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.438938:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 44 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.438967:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec419c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad2 expref: 44 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.438990:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:3.0:1784938193.438998:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439029:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439039:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439073:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938193.439138:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+43:2356:x1871643048745856:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 246us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938193.439146:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00010000:00010000:3.0:1784938193.439180:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439188:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938193.439445:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1784938193.439451:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938193.439484:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439501:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439512:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439519:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.439527:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440320:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ca00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938193.440329:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440341:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440356:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:3.0:1784938193.440360:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938193.440366:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440374:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec41b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440393:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440400:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440406:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440411:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938193.440414:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440420:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440445:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac3861000) 00010000:00010000:3.0:1784938193.440448:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938193.440451:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440457:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec41bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440513:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec41b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad9 expref: 43 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.440532:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad9 expref: 42 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.442528:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:3.0:1784938193.442535:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938193.442685:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d400, rc 0) 00000100:00100000:3.0:1784938193.442869:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+42:11408:x1871643048745472:12345-192.168.201.58@tcp:101:stat.0 Request processed in 18436us (18839us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938193.442879:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:1.0:1784938193.502158:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.502390:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048746112 00000100:00100000:0.0:1784938193.502404:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048746112 00000100:00100000:0.0:1784938193.502480:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:0.0:1784938193.502493:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+42:11414:x1871643048746112:12345-192.168.201.58@tcp:36:truncate.0 00010000:00010000:0.0:1784938193.502608:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938193.502653:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec41c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ad9 expref: 42 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.502679:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938193.502684:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938193.502964:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.502981:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.502992:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938193.503057:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1784938193.503086:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e0f82eb7 reply state 00000000372565bf transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938193.503109:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938193.503305:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:11414:x1871643048746112:12345-192.168.201.58@tcp:36:truncate.0 Request processed in 814us (1161us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1784938193.503314:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 157 00000020:00080000:0.0:1784938193.503321:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938193.509982:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.510006:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.510016:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.510023:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ee800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938193.510030:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.510039:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.510065:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938193.510069:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938193.510075:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.510082:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938193.649898:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938193.650022:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048746240 00000100:00100000:2.0:1784938193.650051:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048746240 00000100:00100000:2.0:1784938193.650127:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:2.0:1784938193.650138:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+43:11428:x1871643048746240:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:2.0:1784938193.650167:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938193.650192:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec41d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ae0 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650305:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650322:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650335:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650349:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650356:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650362:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650484:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650492:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650498:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938193.650558:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1784938193.650564:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938193.650587:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650600:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650620:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650627:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650634:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650641:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938193.650647:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650656:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650671:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938193.650675:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938193.650680:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650687:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec41db lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650717:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650724:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650730:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650735:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938193.650738:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650745:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650752:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b900) 00010000:00010000:2.0:1784938193.650755:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938193.650758:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650764:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec41e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650805:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec41d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 45 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650820:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 44 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.650838:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:2.0:1784938193.650841:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938193.650844:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938193.650929:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:11428:x1871643048746240:12345-192.168.201.58@tcp:101:stat.0 Request processed in 792us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938193.650938:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:1.0:1784938193.740346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.740460:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048746496 00000100:00100000:0.0:1784938193.740495:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048746496 00000100:00100000:0.0:1784938193.740590:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 159 00000100:00100000:0.0:1784938193.740603:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:11438:x1871643048746496:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938193.740635:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938193.740662:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ae7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938193.740825:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1784938193.741114:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae7 expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.741129:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938193.741131:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938193.741136:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec41f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae7 expref: 46 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.741150:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05b021ee800, rc 0) 00000100:00100000:0.0:1784938193.741253:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+45:11438:x1871643048746496:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 652us (918us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1784938193.741261:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 159 00000100:00100000:1.0:1784938193.748708:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.748822:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048746752 00000100:00100000:0.0:1784938193.748836:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048746752 00000100:00100000:0.0:1784938193.748915:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784938193.748926:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+45:11438:x1871643048746752:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938193.749328:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+46:11438:x1871643048746752:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 402us (634us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1784938193.749337:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00010000:00010000:3.0:1784938193.777542:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938193.816744:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938193.816827:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048747008 00000100:00100000:2.0:1784938193.816841:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048747008 00000100:00100000:2.0:1784938193.816923:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 160 00000100:00100000:2.0:1784938193.816936:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+46:11443:x1871643048747008:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938193.816971:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938193.816999:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec41fe lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897aee expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.817130:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.817147:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 47 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.817170:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.817257:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 47 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.817272:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 47 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.817306:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065526528:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938193.817422:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7da4e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938193.823432:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.824433:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048747136 00000100:00100000:0.0:1784938193.824450:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048747136 00010000:00010000:0.0:1784938193.824510:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 48 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938193.824574:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:0.0:1784938193.824585:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+48:2356:x1871643048747136:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938193.824821:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938193.824832:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 48 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.824850:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 48 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.824880:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938193.824887:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.824900:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.824910:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.824937:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938193.825020:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+48:2356:x1871643048747136:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 436us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938193.825029:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00010000:00010000:2.0:1784938193.826336:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec41e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ae0 expref: 47 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.826369:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065526528:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938193.826402:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.826415:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.826422:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938193.826450:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1784938193.826874:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec41fe lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 48 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.826893:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 47 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.826903:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:2.0:1784938193.826907:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938193.826911:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938193.827061:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:11443:x1871643048747008:12345-192.168.201.58@tcp:101:bash.0 Request processed in 10126us (10330us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1784938193.827089:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 160 00000100:00100000:1.0:1784938193.830096:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938193.830352:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048747392 00000100:00100000:2.0:1784938193.830365:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048747392 00000100:00100000:2.0:1784938193.830470:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 161 00000100:00100000:2.0:1784938193.830483:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:11443:x1871643048747392:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:2.0:1784938193.830869:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.830892:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.830906:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938193.830967:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:2.0:1784938193.830996:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000616da8a5 reply state 00000000ac9e5b2c transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.831006:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938193.831123:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:11443:x1871643048747392:12345-192.168.201.58@tcp:36:bash.0 Request processed in 641us (1039us total) trans 4294967449 rc 0/0 00000100:00100000:2.0:1784938193.831131:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 161 00000020:00080000:2.0:1784938193.831137:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1784938193.832972:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.832994:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.833003:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.833011:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938193.833017:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.833027:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.833048:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:1.0:1784938193.833052:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938193.833059:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.833067:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938193.846491:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938193.846632:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048747520 00000100:00100000:3.0:1784938193.846645:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048747520 00000100:00100000:3.0:1784938193.846728:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:3.0:1784938193.846741:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:11443:x1871643048747520:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938193.846775:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938193.846805:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec421a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897af5 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.846936:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.846954:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 50 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.846963:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.847006:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 50 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938193.847021:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 50 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938193.847038:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff835500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065526656:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938193.847144:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05aded6fa80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938193.850642:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.850902:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff835500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065526656:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938193.850959:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938193.851660:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048747648 00000100:00100000:1.0:1784938193.851680:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048747648 00010000:00010000:1.0:1784938193.851732:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 51 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938193.851787:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:1.0:1784938193.851798:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:2356:x1871643048747648:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938193.851816:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938193.851824:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 51 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.851838:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 51 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.851865:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4205 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897aee expref: 51 pid: 7211 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.851887:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:1.0:1784938193.851892:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.851903:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.851910:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938193.851943:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938193.852001:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.852011:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938193.852015:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:2356:x1871643048747648:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 219us (1391us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938193.852032:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000004:00200000:0.0:1784938193.852076:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1784938193.852082:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938193.852109:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.852148:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec421a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897af5 expref: 50 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.852166:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897af5 expref: 49 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.852173:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938193.852176:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938193.852178:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c400, rc 0) 00000100:00100000:0.0:1784938193.852277:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:11443:x1871643048747520:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5538us (5800us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938193.852284:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:1.0:1784938193.855780:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.855862:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048747904 00000100:00100000:0.0:1784938193.855874:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048747904 00000100:00100000:0.0:1784938193.855948:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:0.0:1784938193.855960:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+49:11443:x1871643048747904:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1784938193.856330:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:11443:x1871643048747904:12345-192.168.201.58@tcp:35:bash.0 Request processed in 371us (568us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1784938193.856339:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1784938193.953907:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.954033:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048748160 00000100:00100000:0.0:1784938193.954048:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048748160 00000100:00100000:0.0:1784938193.954130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:0.0:1784938193.954142:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:11454:x1871643048748160:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938193.954177:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938193.954259:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4228 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897afc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938193.954413:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:0.0:1784938193.954578:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4228 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897afc expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.954596:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938193.954599:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938193.954606:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec4228 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897afc expref: 52 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.954802:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05b021ee200, rc 0) 00000100:00100000:0.0:1784938193.954878:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:11454:x1871643048748160:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 737us (986us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1784938193.954886:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:3.0:1784938193.958057:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938193.958171:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048748288 00000100:00100000:2.0:1784938193.958184:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048748288 00000100:00100000:2.0:1784938193.958288:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 164 00000100:00100000:2.0:1784938193.958298:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:11454:x1871643048748288:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:2.0:1784938193.958414:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958431:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958443:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958457:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958464:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958469:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958594:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958601:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958606:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938193.958667:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958682:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958695:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958700:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958704:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938193.958709:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958715:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958725:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938193.958727:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938193.958731:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958734:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958746:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958750:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958754:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958756:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938193.958761:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958766:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958772:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b900) 00010000:00010000:2.0:1784938193.958775:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938193.958777:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958783:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec423d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958799:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958805:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958811:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958815:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938193.958818:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958823:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958829:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:2.0:1784938193.958831:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938193.958839:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938193.958844:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938193.958919:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:11454:x1871643048748288:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 623us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938193.958926:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 164 00000100:00100000:1.0:1784938193.962309:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.962404:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048748544 00000100:00100000:0.0:1784938193.962415:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048748544 00000100:00100000:0.0:1784938193.962467:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1784938193.962491:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:11454:x1871643048748544:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938193.962831:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:11454:x1871643048748544:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 340us (534us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1784938193.962839:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:1.0:1784938193.998465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938193.998577:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048748800 00000100:00100000:0.0:1784938193.998589:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048748800 00000100:00100000:0.0:1784938193.998679:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 165 00000100:00100000:0.0:1784938193.998691:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:11457:x1871643048748800:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938193.998727:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938193.998754:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec424b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b03 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.998841:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.998855:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.998865:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.998877:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.998881:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.998885:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999049:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999056:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999060:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938193.999068:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784938193.999170:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999175:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999181:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999185:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ee800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938193.999188:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999194:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999253:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938193.999256:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938193.999261:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999272:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee800/0xea86628a8aec4252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999286:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999290:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999293:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999297:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938193.999298:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999302:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999306:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac30f8700) 00010000:00010000:0.0:1784938193.999307:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938193.999308:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999311:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999350:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05b021ee200/0xea86628a8aec424b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b03 expref: 55 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999361:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b03 expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938193.999370:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938193.999372:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938193.999374:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:0.0:1784938193.999431:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11457:x1871643048748800:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 743us (980us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1784938193.999437:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 165 00000100:00100000:3.0:1784938194.002014:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.002134:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048748928 00000100:00100000:2.0:1784938194.002146:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048748928 00000100:00100000:2.0:1784938194.002261:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:2.0:1784938194.002271:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11457:x1871643048748928:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784938194.002348:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002365:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002375:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002404:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002408:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002413:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002417:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.002435:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002441:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002451:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:2.0:1784938194.002454:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938194.002458:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.002463:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec426e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938194.002540:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11457:x1871643048748928:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 261us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.002547:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00080000:3.0:1784938194.002662:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938194.003288:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938194.003396:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048749056 00000100:00100000:3.0:1784938194.003403:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048749056 00000100:00100000:3.0:1784938194.003457:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784938194.003466:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:2356:x1871643048749056:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938194.003479:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938194.003510:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b03 expref: 54 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938194.003526:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:3.0:1784938194.003539:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938194.003583:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+53:2356:x1871643048749056:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 118us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938194.003591:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938194.006986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938194.007075:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048749312 00000100:00100000:0.0:1784938194.007086:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048749312 00000100:00100000:0.0:1784938194.007143:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:0.0:1784938194.007152:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+53:11457:x1871643048749312:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938194.007438:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11457:x1871643048749312:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 286us (463us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1784938194.007447:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1784938194.209264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938194.217556:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048749568 00000100:00100000:0.0:1784938194.217578:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048749568 00000100:00100000:0.0:1784938194.217673:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:0.0:1784938194.217687:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11475:x1871643048749568:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1784938194.217721:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938194.217749:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4275 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b0a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.217887:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec427c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.217907:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec427c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.217954:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec427c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938194.217971:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1784938194.218153:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b0a expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.218180:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec427c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b0a expref: 56 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.218191:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:0.0:1784938194.218205:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1784938194.218210:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:0.0:1784938194.218591:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11475:x1871643048749568:12345-192.168.201.58@tcp:101:cat.0 Request processed in 906us (9405us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1784938194.218601:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:1.0:1784938194.259061:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.259208:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048749696 00000100:00100000:2.0:1784938194.259262:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048749696 00000100:00100000:2.0:1784938194.259387:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:2.0:1784938194.259398:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11476:x1871643048749696:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938194.259432:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938194.259523:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec428a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b11 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.259633:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.259651:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.259688:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938194.259770:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1784938194.259774:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938194.259800:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.259831:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec428a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b11 expref: 58 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.259855:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b11 expref: 57 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.259865:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938194.259867:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938194.259872:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893400, rc 0) 00000100:00100000:2.0:1784938194.259945:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11476:x1871643048749696:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 549us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.259952:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:1.0:1784938194.270897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938194.271346:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750080 00000100:00100000:0.0:1784938194.271361:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750080 00000100:00100000:0.0:1784938194.271626:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784938194.271640:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11476:x1871643048750080:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938194.273053:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11476:x1871643048750080:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 1366us (2123us total) trans 4294967456 rc 0/0 00000100:00100000:0.0:1784938194.273069:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:1.0:1784938194.276373:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.276563:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750208 00000100:00100000:2.0:1784938194.276579:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750208 00000100:00100000:2.0:1784938194.276673:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1784938194.276687:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11476:x1871643048750208:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:2.0:1784938194.276709:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784938194.276743:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4221 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897af5 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.276797:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec427c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b0a expref: 57 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.276810:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec412c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ab6 expref: 56 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.276823:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:2.0:1784938194.276838:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938194.276916:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11476:x1871643048750208:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 234us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.276924:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784938194.279952:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938194.280106:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750336 00000100:00100000:0.0:1784938194.280127:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750336 00000100:00100000:0.0:1784938194.280196:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 169 00000100:00100000:0.0:1784938194.280207:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11476:x1871643048750336:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:0.0:1784938194.280406:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.280764:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.280782:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938194.281096:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1784938194.281811:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11476:x1871643048750336:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 1599us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.281823:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 169 00000100:00100000:0.0:1784938194.308378:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938194.308516:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750464 00000100:00100000:3.0:1784938194.308543:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750464 00000100:00100000:3.0:1784938194.309962:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 170 00000100:00100000:3.0:1784938194.309989:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11478:x1871643048750464:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938194.310020:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938194.310050:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec429f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b18 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938194.314485:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938194.314521:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938194.314548:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.315667:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.315689:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.315701:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.315839:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.315847:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.315854:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938194.315926:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784938194.316091:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938194.316717:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316737:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316749:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316756:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316765:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316772:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.316777:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316787:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316805:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938194.316808:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938194.316815:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316822:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec42a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316860:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316867:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316872:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316878:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.316881:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316886:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316894:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b900) 00010000:00010000:2.0:1784938194.316897:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938194.316900:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316905:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316973:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec429f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.316990:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 56 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.317008:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:2.0:1784938194.317011:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938194.317014:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938194.318187:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11478:x1871643048750464:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 8198us (9813us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.318200:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 170 00000100:00100000:2.0:1784938194.484562:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065526912:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.484694:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065526784:0@lo:400:kworker.0 00000100:00100000:0.0:1784938194.484793:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938194.484859:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065527296:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.484939:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938194.484946:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065527168:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.485008:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065527040:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.485052:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065526784 00000100:00100000:0.0:1784938194.485061:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065526784 00000100:00100000:0.0:1784938194.485118:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1784938194.485127:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065526784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938194.485505:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87ddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065526784:12345-0@lo:400:kworker.0 Request processed in 377us (711us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.485542:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1784938194.485820:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938194.485875:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938194.485897:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938194.485930:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065527168 00000100:00100000:0.0:1784938194.485936:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065527168 00000100:00100000:0.0:1784938194.486108:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 89 00000100:00100000:0.0:1784938194.486117:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3324:x1871643065527168:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.486167:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3324:x1871643065527168:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 51us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.486174:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 89 00000100:00100000:0.0:1784938194.486288:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065527296 00000100:00100000:0.0:1784938194.486294:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065527296 00000100:00100000:0.0:1784938194.486327:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065527040 00000100:00100000:0.0:1784938194.486330:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065527040 00000100:00100000:0.0:1784938194.486353:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 158 00000100:00100000:0.0:1784938194.486360:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065527296:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.486387:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065527296:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 28us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.486395:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 158 00000100:00100000:0.0:1784938194.486406:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 159 00000100:00100000:0.0:1784938194.486412:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065527040:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.486432:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065527040:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 20us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.486438:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 159 00000100:00080000:0.0:1784938194.486480:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938194.486486:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938194.489436:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065527424:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938194.493045:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065526784:0@lo:400:kworker.0 00000100:00100000:3.0:1784938194.493106:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5258380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065527168:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.493709:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938194.493778:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065527040:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.493820:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065526912 00000100:00100000:0.0:1784938194.493828:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065526912 00000100:00100000:0.0:1784938194.493883:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 160 00000100:00100000:0.0:1784938194.493893:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065526912:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.494102:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065526912:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 209us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.494111:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 160 00000100:00100000:3.0:1784938194.494427:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af525b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065527296:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938194.494752:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5259c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065526912:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938194.494955:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938194.495023:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065527424 00000100:00100000:3.0:1784938194.495030:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065527424 00000100:00100000:3.0:1784938194.495083:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 90 00000100:00100000:3.0:1784938194.495092:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065527424:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938194.500285:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065527424:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 5170us (5306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938194.500306:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 90 00000100:00080000:0.0:1784938194.503312:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938194.507790:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbc7c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065527424:192.168.201.158@tcp:400:kworker.0 00010000:00010000:1.0:1784938194.804861:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938194.874172:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.874249:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.874279:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.874368:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.874404:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750592 00000100:00100000:2.0:1784938194.874417:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750592 00000100:00100000:2.0:1784938194.874482:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 296 00000100:00100000:2.0:1784938194.874495:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048750592:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938194.874606:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048750592:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 113us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.874616:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 296 00000100:00100000:2.0:1784938194.874663:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750720 00000100:00100000:2.0:1784938194.874667:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750720 00000100:00100000:2.0:1784938194.874703:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 161 00000100:00100000:2.0:1784938194.874732:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:2356:x1871643048750720:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938194.874770:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:2356:x1871643048750720:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 40us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.874777:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 161 00000100:00100000:2.0:1784938194.874798:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750976 00000100:00100000:2.0:1784938194.874802:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750976 00000100:00100000:2.0:1784938194.874842:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048750848 00000100:00100000:2.0:1784938194.874845:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048750848 00000100:00100000:2.0:1784938194.874872:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784938194.874878:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048750976:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938194.874910:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048750976:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.874916:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784938194.874927:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:2.0:1784938194.874933:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048750848:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938194.874956:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048750848:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.874962:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00080000:2.0:1784938194.875121:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938194.875126:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938194.878407:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.878467:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048751104 00000100:00100000:2.0:1784938194.878480:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048751104 00000100:00100000:2.0:1784938194.878576:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:2.0:1784938194.878588:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048751104:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938194.878682:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2355:x1871643048751104:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 96us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.878708:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00080000:2.0:1784938194.878736:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1784938194.934503:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938194.934528:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938194.934754:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1784938194.934762:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938194.936962:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065527552:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784938194.937178:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938194.942765:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13c700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065527552:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784938194.942945:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.943421:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048751232 00000100:00100000:2.0:1784938194.943431:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048751232 00000100:00100000:2.0:1784938194.943507:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:2.0:1784938194.943529:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11489:x1871643048751232:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784938194.943576:0:7211:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784938194.945888:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11489:x1871643048751232:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 2341us (2924us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.945907:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:3.0:1784938194.955668:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.958432:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048751360 00000100:00100000:2.0:1784938194.958455:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048751360 00000100:00100000:2.0:1784938194.960872:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:2.0:1784938194.960899:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11489:x1871643048751360:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784938194.961021:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.961043:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.961071:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965143:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965171:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965186:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965269:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965280:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965288:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938194.965338:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1784938194.965344:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938194.965360:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965373:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965380:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965407:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965413:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.965420:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965428:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965440:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:2.0:1784938194.965444:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938194.965449:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965456:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec42bb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965469:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965475:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965481:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965486:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.965489:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965505:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965526:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffffa05ad886b900) 00010000:00010000:2.0:1784938194.965529:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938194.965533:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965539:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec42c2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965555:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965562:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965568:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965573:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.965576:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965582:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965590:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:2.0:1784938194.965593:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938194.965596:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.965613:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec42c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938194.967118:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11489:x1871643048751360:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 6220us (11454us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938194.967133:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:3.0:1784938194.970323:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938194.970462:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048751616 00000100:00100000:2.0:1784938194.970475:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048751616 00000100:00100000:2.0:1784938194.970569:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:2.0:1784938194.970582:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:11489:x1871643048751616:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938194.970606:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938194.970634:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b1f expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.970935:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.970952:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.970965:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938194.970976:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784938194.971098:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971106:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971131:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971137:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938194.971142:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971149:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971162:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:2.0:1784938194.971164:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938194.971169:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971174:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec42d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971261:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42d0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b1f expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971272:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:2.0:1784938194.971275:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938194.971279:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b1f expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938194.971290:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938194.971374:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5259c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11489:x1871643048751616:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 794us (1064us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1784938194.971395:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:2.0:1784938194.983567:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938194.984115:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048751744 00000100:00100000:0.0:1784938194.984125:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048751744 00000100:00100000:0.0:1784938194.984196:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 174 00000100:00100000:0.0:1784938194.984206:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11489:x1871643048751744:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784938194.984296:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784938194.984420:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11489:x1871643048751744:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 215us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938194.984428:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 174 00000100:00100000:3.0:1784938194.995274:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938194.995318:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee13ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065527680:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938194.996162:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938194.997853:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065527680 00000100:00100000:1.0:1784938194.997869:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065527680 00000100:00100000:1.0:1784938194.997948:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 71 00000100:00100000:1.0:1784938194.997963:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065527680:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938194.998011:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938194.998011:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938194.998075:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048752000 00000100:00100000:0.0:1784938194.998084:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048752000 00000100:00100000:1.0:1784938194.998098:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065527680:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 137us (1938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938194.998109:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 71 00000100:00100000:0.0:1784938194.998153:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:0.0:1784938194.998176:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11489:x1871643048752000:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938194.998199:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938194.998203:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938194.998279:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b11 expref: 57 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938194.998307:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938194.998314:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938194.998333:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec42e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b26 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938194.998632:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee13ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065527680:192.168.201.158@tcp:13:osp-pre-1-0.0 00000004:00080000:0.0:1784938194.999345:0:5806:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1784938195.003396:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec42ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.003495:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec42ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.003520:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec42ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.004401:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec42e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b26 expref: 59 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.005066:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec42ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b26 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.005078:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938195.005081:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938195.005104:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:0.0:1784938195.005239:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11489:x1871643048752000:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 7040us (7271us total) trans 4294967458 rc 0/0 00000100:00100000:0.0:1784938195.005250:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:1.0:1784938195.018991:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.019152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048752256 00000100:00100000:2.0:1784938195.019167:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048752256 00000100:00100000:2.0:1784938195.019240:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:2.0:1784938195.019248:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11489:x1871643048752256:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.019302:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938195.019326:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec42ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b26 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019343:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:2.0:1784938195.019354:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938195.019375:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019386:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019394:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019403:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019407:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019412:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019499:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019506:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019527:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019533:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938195.019538:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019546:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019556:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938195.019559:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938195.019563:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019569:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec42fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019580:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019586:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019592:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019604:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938195.019606:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019611:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019616:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb9477e6a (ffffa05ad886b900) 00010000:00010000:2.0:1784938195.019618:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938195.019620:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.019624:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4301 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9477e6a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938195.019700:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11489:x1871643048752256:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 452us (723us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938195.019704:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:0.0:1784938195.033903:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.033976:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048752384 00000100:00100000:2.0:1784938195.033992:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048752384 00000100:00100000:2.0:1784938195.034154:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:2.0:1784938195.034165:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11489:x1871643048752384:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.034184:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938195.034207:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b2d expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.034296:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.034321:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.034331:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.034414:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 59 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.034426:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 58 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.034433:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938195.034436:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938195.034439:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938195.034507:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11489:x1871643048752384:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 344us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.034527:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:1.0:1784938195.042146:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.042314:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048752640 00000100:00100000:2.0:1784938195.042329:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048752640 00000100:00100000:2.0:1784938195.042401:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 178 00000100:00100000:2.0:1784938195.042412:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11489:x1871643048752640:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.042580:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.042614:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.042642:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938195.043329:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1784938195.043344:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403986127551ns, next at 404986124727ns, rc = 0 00000004:00010000:2.0:1784938195.043461:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056b3e4c4 reply state 000000004acb3463 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938195.043484:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938195.045191:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11489:x1871643048752640:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 2754us (3034us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1784938195.045207:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 178 00000100:00100000:2.0:1784938195.049037:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1784938195.049418:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.049434:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.049443:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.049450:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938195.049456:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.049466:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.049505:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:3.0:1784938195.049508:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1784938195.049525:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.049531:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4316 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.050174:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048752768 00000100:00100000:0.0:1784938195.050199:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048752768 00000100:00100000:2.0:1784938195.050568:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179 00000100:00100000:2.0:1784938195.050583:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11489:x1871643048752768:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.050626:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938195.050653:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b34 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.050746:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.050765:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.050787:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938195.050803:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938195.050807:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938195.050890:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11489:x1871643048752768:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 310us (1870us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.050898:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179 00000100:00100000:2.0:1784938195.054307:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.054560:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048752896 00000100:00100000:0.0:1784938195.054578:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048752896 00000100:00100000:0.0:1784938195.054668:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1784938195.054680:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048752896:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1784938195.055129:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048752896:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 450us (920us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1784938195.055138:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1784938195.058645:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.058756:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048753152 00000100:00100000:2.0:1784938195.058769:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048753152 00000100:00100000:2.0:1784938195.058844:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784938195.058856:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11489:x1871643048753152:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784938195.059172:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11489:x1871643048753152:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 318us (542us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1784938195.059181:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1784938195.062039:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.062392:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048753408 00000100:00100000:0.0:1784938195.062405:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048753408 00000100:00100000:0.0:1784938195.062482:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:0.0:1784938195.062494:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11489:x1871643048753408:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784938195.062660:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11489:x1871643048753408:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 168us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.062668:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:3.0:1784938195.065051:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.065171:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048753536 00000100:00100000:2.0:1784938195.065194:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048753536 00000100:00100000:2.0:1784938195.065325:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:2.0:1784938195.065336:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11489:x1871643048753536:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.065364:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938195.065395:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4324 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b3b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.065493:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec432b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.065524:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec432b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.065540:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec432b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938195.065630:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938195.065655:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec432b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.065691:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4324 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b3b expref: 63 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.065714:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec432b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b3b expref: 62 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.065724:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938195.065728:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784938195.065731:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938195.065818:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11489:x1871643048753536:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 485us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.065826:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:1.0:1784938195.078208:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.078452:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048753664 00000100:00100000:2.0:1784938195.078468:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048753664 00000100:00100000:2.0:1784938195.078562:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784938195.078575:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048753664:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.078615:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938195.078646:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b42 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938195.078683:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63fed3, blocks: 0x1 00010000:00010000:2.0:1784938195.078712:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=404s v=(0 0) 00010000:00010000:2.0:1784938195.078736:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938195.078748:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 8 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.078774:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 8 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.078791:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892600, rc 0) 00000100:00100000:2.0:1784938195.078873:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048753664:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 300us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.078880:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1784938195.086708:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.087842:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048753920 00000100:00100000:0.0:1784938195.087861:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048753920 00000100:00100000:0.0:1784938195.087952:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:0.0:1784938195.087963:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11489:x1871643048753920:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784938195.088123:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5258380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11489:x1871643048753920:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 161us (1431us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.088131:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:0.0:1784938195.091443:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.091493:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754048 00000100:00100000:0.0:1784938195.091505:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754048 00000100:00100000:0.0:1784938195.091581:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784938195.091659:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:11489:x1871643048754048:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938195.091690:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938195.091722:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b49 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.091770:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 9 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.091780:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938195.091785:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938195.091790:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 9 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.091838:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 9 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.091854:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 9 pid: 6602 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.091893:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065527808:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938195.092059:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938195.104676:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.104731:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754176 00000100:00100000:0.0:1784938195.104744:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754176 00010000:00010000:0.0:1784938195.104802:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 10 pid: 6602 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.104847:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1784938195.104858:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2356:x1871643048754176:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938195.104876:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938195.104916:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 10 pid: 6602 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.104932:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 10 pid: 6602 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.104965:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938195.104970:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938195.104980:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 10 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.104991:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 10 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.105059:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 10 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.105076:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff883800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1871643065527936:192.168.201.58@tcp:105: 00000100:00100000:0.0:1784938195.105172:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de3c0 going to sleep for 11 seconds 00010000:00010000:3.0:1784938195.109304:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4332 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b42 expref: 10 pid: 6602 timeout: 504 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938195.109339:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff881c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065527808:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938195.109380:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 9 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.109401:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05b021ee800, rc 0) 00000100:00100000:3.0:1784938195.109490:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:11489:x1871643048754048:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 17898us (18062us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.109500:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784938195.114491:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.114539:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754304 00000100:00100000:0.0:1784938195.114552:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754304 00002000:00100000:0.0:1784938195.114631:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa05aff881c00 x1871643048754304/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:426/0 lens 504/0 e 0 to 0 dl 1784938206 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938195.114643:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff881c00 with x1871643048754304 ext(0->8) 00002000:00010000:0.0:1784938195.114649:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aff881c00 00000100:00100000:0.0:1784938195.114685:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1784938195.114696:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2356:x1871643048754304:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1784938195.115290:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:2356:x1871643048754304:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 592us (809us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1784938195.115300:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00002000:00100000:0.0:1784938195.115308:0:6609:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffffa05aff881c00 x1871643048754304/t4294967314(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:426/0 lens 504/448 e 0 to 0 dl 1784938206 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1784938195.115316:0:6609:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aff881c00 with x1871643048754304 ext(0->8) 00002000:00010000:0.0:1784938195.115319:0:6609:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aff881c00 00000100:00100000:0.0:1784938195.115391:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff883800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1871643065527936:192.168.201.58@tcp:105: 00010000:00010000:0.0:1784938195.115429:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938195.115455:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2356:x1871643048754176:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 10599us (10795us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.115465:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1784938195.121834:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.121890:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754432 00000100:00100000:0.0:1784938195.121901:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754432 00000100:00100000:0.0:1784938195.121970:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 183 00000100:00100000:0.0:1784938195.121982:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11489:x1871643048754432:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1784938195.247473:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11489:x1871643048754432:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 125478us (125639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.247489:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 183 00000001:00080000:3.0:1784938195.247548:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000004:00080000:3.0:1784938195.247853:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1784938195.247898:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05ac88050c0 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1784938195.247903:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ae1706500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05ad1bd6e40 00000020:00080000:3.0:1784938195.247906:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05ae1706600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05af5256c00 00000001:00080000:3.0:1784938195.247937:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1784938195.247945:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000100:00100000:1.0:1784938195.248946:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065528064:192.168.201.158@tcp:6:osp-syn-0-0.0 00000100:00100000:1.0:1784938195.249296:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938195.249349:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065528064 00000100:00100000:1.0:1784938195.249357:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065528064 00000100:00100000:1.0:1784938195.249419:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:1.0:1784938195.249430:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1871643065528064:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 00002000:00080000:1.0:1784938195.249467:0:6602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1784938195.249522:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a63fed1, atime: 0x6a63fed1, ctime: 0x6a63fed1, blocks: 0x1 00010000:00010000:1.0:1784938195.249532:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.249553:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=404s v=(0 0) 00010000:00010000:1.0:1784938195.249558:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938195.249565:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.249584:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.249725:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.249735:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.249757:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938195.250955:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065528064:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 Request processed in 1519us (1653us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1784938195.250975:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 53 00000100:00100000:3.0:1784938195.253334:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000020:00080000:3.0:1784938195.253374:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1784938195.253648:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1784938195.253801:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065528192:192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00100000:3.0:1784938195.253937:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754560 00000100:00100000:3.0:1784938195.253947:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754560 00000100:00100000:3.0:1784938195.254003:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:3.0:1784938195.254014:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2356:x1871643048754560:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1784938195.254091:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938195.254101:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.254116:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938195.254121:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.254132:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.254156:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.254184:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee8c7f12/0xea86628a8aec4340 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.254246:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938195.254248:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938195.254250:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938195.255994:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938195.256038:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065528192 00000100:00100000:3.0:1784938195.256049:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065528192 00000100:00100000:3.0:1784938195.256104:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 55 00000100:00100000:3.0:1784938195.256116:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065528192:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 00002000:00010000:3.0:1784938195.256405:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1784938195.256410:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784938196 00002000:00010000:3.0:1784938195.256413:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1784938195.256415:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784938195 -> 1784938196 00002000:00010000:3.0:1784938195.256417:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1784938195.257441:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff872300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3324:x1871643065528192:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 Request processed in 1319us (1451us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1784938195.257455:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 55 00000004:00080000:1.0:1784938195.264549:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05b01ddd180/2, rc 0, transno 4294967307 00000100:00100000:1.0:1784938195.264577:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065528064:192.168.201.158@tcp:6:osp-syn-0-0.0 00000004:00080000:3.0:1784938195.272490:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aff870380/2, rc 0, transno 4294967315 00000100:00100000:3.0:1784938195.272528:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff870380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065528192:192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00100000:3.0:1784938195.324780:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2356:x1871643048754560:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 70749us (71438us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938195.324799:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000001:00080000:3.0:1784938195.324868:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000040:00080000:1.0:1784938195.327638:0:12373:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938195.327648:0:12373:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938195.327711:0:12373:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1784938195.327717:0:12373:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938195.339839:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938195.339929:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754816 00000100:00100000:1.0:1784938195.339955:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754816 00000100:00100000:1.0:1784938195.340069:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 184 00000100:00100000:1.0:1784938195.340081:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11489:x1871643048754816:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938195.340158:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938195.340206:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec432b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b3b expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.340265:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:1.0:1784938195.340272:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938195.340314:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.340331:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.340342:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938195.340688:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e38e468f reply state 00000000321a9db8 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938195.340719:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938195.340850:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11489:x1871643048754816:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 771us (1026us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1784938195.340858:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 184 00000100:00100000:2.0:1784938195.345758:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.345956:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048754944 00000100:00100000:0.0:1784938195.345970:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048754944 00000100:00100000:0.0:1784938195.346042:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:0.0:1784938195.346053:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048754944:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00010000:00010000:3.0:1784938195.346280:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.346294:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.346303:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.346311:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938195.346317:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.346326:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.346347:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:3.0:1784938195.346350:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938195.346356:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.346363:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991800/0xea86628a8aec4347 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938195.346559:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1784938195.346563:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1784938196 -> 1784938194 00002000:00010000:0.0:1784938195.346566:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784938193 00002000:00010000:0.0:1784938195.346568:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784938196 -> 1784938194 00002000:00010000:0.0:1784938195.346570:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1784938195.346759:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2356:x1871643048754944:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 706us (1012us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1784938195.346768:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:2.0:1784938195.352622:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.353675:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048755200 00000100:00100000:0.0:1784938195.353696:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048755200 00000100:00100000:0.0:1784938195.353787:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 185 00000100:00100000:0.0:1784938195.353799:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11489:x1871643048755200:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1784938195.353918:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.353939:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.353950:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.353997:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 18 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.354013:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 18 pid: 7211 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.354030:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac868c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065528320:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938195.354150:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938195.356502:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.356594:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac868c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065528320:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938195.356596:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048755328 00000100:00100000:1.0:1784938195.356615:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048755328 00010000:00010000:1.0:1784938195.356666:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 19 pid: 7211 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938195.356710:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:1.0:1784938195.356720:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:2355:x1871643048755328:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938195.356736:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938195.356743:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 19 pid: 7211 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.356757:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 19 pid: 7211 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.356783:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec430f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b2d expref: 19 pid: 7211 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.356802:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:1.0:1784938195.356807:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.356815:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.356839:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.356862:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938195.356921:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938195.356932:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:2355:x1871643048755328:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 214us (446us total) trans 0 rc 0/0 00010000:00010000:0.0:1784938195.356933:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.356940:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938195.356941:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00010000:00010000:0.0:1784938195.356978:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.356997:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.357004:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.357010:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938195.357015:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.357024:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.357034:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:0.0:1784938195.357037:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1784938195.357041:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.357047:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec434e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.357094:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:11489:x1871643048755200:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 3298us (4500us total) trans 0 rc -22/-22 00000100:00100000:0.0:1784938195.357104:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 185 00000100:00100000:2.0:1784938195.362556:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.362619:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048755456 00000100:00100000:2.0:1784938195.362632:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048755456 00000100:00100000:2.0:1784938195.362693:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:2.0:1784938195.362703:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2357:x1871643048755456:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784938195.362759:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.362784:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.362793:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938195.362804:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938195.362809:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.362855:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.362872:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 8 pid: 6604 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938195.362890:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065528448:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938195.363201:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938195.381884:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.381952:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048755584 00000100:00100000:0.0:1784938195.381967:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048755584 00010000:00010000:0.0:1784938195.382023:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 9 pid: 6604 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.382076:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:0.0:1784938195.382096:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2356:x1871643048755584:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938195.382113:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938195.382144:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 9 pid: 6604 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.382161:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 9 pid: 6604 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.382195:0:8373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938195.382201:0:8373:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938195.382208:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.382239:0:8373:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.382385:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938195.382441:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021d572cb/0xea86628a8aec4339 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b49 expref: 9 pid: 6604 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.382450:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2356:x1871643048755584:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 357us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.382457:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784938195.382458:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065528448:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938195.382484:0:6604:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382496:0:6604:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382504:0:6604:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382546:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382554:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382574:0:6604:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382580:0:6604:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938195.382585:0:6604:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382610:0:6604:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382625:0:6604:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.382632:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2909e5e/0xea86628a8aec4355 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938195.382693:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2357:x1871643048755456:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 19991us (20152us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938195.382701:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1784938195.389210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938195.391915:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048755840 00000100:00100000:2.0:1784938195.391935:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048755840 00000100:00100000:1.0:1784938195.393369:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:1.0:1784938195.393383:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+17:11489:x1871643048755840:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1784938195.393479:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.393495:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.393541:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.394007:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.394022:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.394032:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.394077:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.394094:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 18 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938195.394112:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065528576:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938195.394485:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7da4180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938195.402014:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.402132:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065528576:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938195.402166:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938195.402273:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048755968 00000100:00100000:2.0:1784938195.402282:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048755968 00010000:00010000:2.0:1784938195.402329:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 19 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938195.402373:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:2.0:1784938195.402384:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:2355:x1871643048755968:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938195.402403:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938195.402410:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 19 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402434:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 19 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402460:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec431d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b34 expref: 19 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402476:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938195.402482:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402493:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402502:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402541:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938195.402602:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:2355:x1871643048755968:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 219us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938195.402611:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00010000:00010000:2.0:1784938195.402639:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.402647:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938195.402889:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1784938195.403065:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1784938195.403117:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1784938195.403251:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065528704:192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:2.0:1784938195.403326:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938195.404069:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938195.404306:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065528704 00000100:00100000:0.0:1784938195.404316:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065528704 00000100:00100000:0.0:1784938195.404368:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00100000:0.0:1784938195.404381:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1871643065528704:12345-192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:0.0:1784938195.404464:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1871643065528704:12345-192.168.201.158@tcp:1000:mdt00_001.0 Request processed in 83us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938195.404472:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00100000:0.0:1784938195.404663:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065528704:192.168.201.158@tcp:1000:mdt00_001.0 00000001:00080000:0.0:1784938195.405099:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1784938195.405165:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac868c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065528832:192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:0.0:1784938195.405301:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938195.407953:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938195.409401:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065528832 00000100:00100000:1.0:1784938195.409418:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065528832 00000100:00100000:1.0:1784938195.409483:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:1.0:1784938195.409495:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1871643065528832:12345-192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:1.0:1784938195.409815:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5805:x1871643065528832:12345-192.168.201.158@tcp:1000:mdt00_001.0 Request processed in 321us (1882us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1784938195.409825:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:2.0:1784938195.410476:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac868c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065528832:192.168.201.158@tcp:1000:mdt00_001.0 00010000:00010000:2.0:1784938195.410546:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410559:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410568:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410575:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938195.410580:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410596:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410615:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938195.410618:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938195.410625:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410632:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec4363 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410667:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410687:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410693:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410698:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938195.410701:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410706:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410714:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:2.0:1784938195.410716:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938195.410719:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410724:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a400/0xea86628a8aec4298 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410751:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410765:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410775:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410818:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 21 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938195.410840:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 21 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938195.410857:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065528960:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938195.410938:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1784938195.414313:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.414357:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048756096 00000100:00100000:0.0:1784938195.414369:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048756096 00010000:00010000:0.0:1784938195.414420:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 22 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.414477:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:3.0:1784938195.414480:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f480 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065528960:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938195.414487:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:2356:x1871643048756096:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938195.414532:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.414534:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938195.414541:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 22 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.414555:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 22 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.415689:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec42b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b18 expref: 22 pid: 5806 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.415711:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:0.0:1784938195.415722:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.415732:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.415739:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.415765:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938195.415785:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415793:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415809:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415815:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415822:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415829:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938195.415833:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.415839:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee358700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2356:x1871643048756096:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1352us (1542us total) trans 0 rc 0/0 00010000:00010000:3.0:1784938195.415842:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938195.415849:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00010000:00010000:3.0:1784938195.415851:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:3.0:1784938195.415854:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938195.415858:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415863:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec436a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415874:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415887:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415893:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415899:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991c00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938195.415902:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415909:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415918:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac30f8700) 00010000:00010000:3.0:1784938195.415920:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1784938195.415923:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.415928:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991c00/0xea86628a8aec435c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938195.416445:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11489:x1871643048755840:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 23061us (27248us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1784938195.416456:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 186 00000020:00080000:3.0:1784938195.416461:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784938195.416774:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938195.416780:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938195.417139:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1784938195.417148:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938195.419706:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938195.419782:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048756352 00000100:00100000:0.0:1784938195.419796:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048756352 00000100:00100000:0.0:1784938195.419870:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1784938195.419882:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11489:x1871643048756352:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784938195.421028:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784938195.421116:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1784938195.421166:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.421186:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.421199:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.421567:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.421576:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938195.421582:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938195.421668:0:5807:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1784938195.421797:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:11489:x1871643048756352:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1914us (2100us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1784938195.421808:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000020:00080000:1.0:1784938195.421816:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1784938195.421913:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938195.421920:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.421938:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938195.421944:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.421952:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.421968:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffffa05ac30f8c00) 00010000:00010000:3.0:1784938195.421971:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1784938195.421977:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.421983:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4371 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938195.422003:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938195.422005:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938195.422007:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938195.825636:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784938196.604636:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1784938196.604666:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00010000:00010000:1.0:1784938196.854925:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938197.395807:0:12425:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938197.395820:0:12425:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938197.395862:0:12425:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1784938197.395871:0:12425:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938197.558039:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938197.558078:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065529088:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938197.558807:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938197.560828:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065529088 00000100:00100000:1.0:1784938197.560851:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065529088 00000100:00100000:1.0:1784938197.560977:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 72 00000100:00100000:1.0:1784938197.560992:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065529088:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938197.561046:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938197.561134:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065529088:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 146us (2331us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938197.561142:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 72 00000100:00080000:2.0:1784938197.561339:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938197.561620:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:2.0:1784938197.561628:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:2.0:1784938197.561653:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05b01ddd180, transno 4294967307 00000100:00100000:2.0:1784938197.561681:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065529088:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938197.626198:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.626270:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048756608 00000100:00100000:3.0:1784938197.626284:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048756608 00000100:00100000:3.0:1784938197.626368:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:3.0:1784938197.626381:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:11507:x1871643048756608:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938197.626417:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938197.626448:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec4378 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b50 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.626781:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec437f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.626808:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec437f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.626824:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec437f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938197.626840:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1784938197.627063:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec4378 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b50 expref: 25 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.627084:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec437f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b50 expref: 24 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.627095:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:3.0:1784938197.627098:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938197.627102:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d200, rc 0) 00000100:00100000:3.0:1784938197.627190:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5379c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:11507:x1871643048756608:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 812us (1006us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1784938197.627200:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00080000:3.0:1784938197.627250:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938197.637914:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938197.647881:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048756736 00000100:00100000:1.0:1784938197.647902:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048756736 00000100:00100000:1.0:1784938197.648142:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:1.0:1784938197.648155:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:11507:x1871643048756736:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:1.0:1784938197.648285:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.648308:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.648321:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.648351:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.648359:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.651966:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652383:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652400:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652409:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938197.652490:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652509:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652515:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652522:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652528:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938197.652534:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652628:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652645:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:1.0:1784938197.652647:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938197.652653:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652660:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec438d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652671:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652677:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652683:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652688:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938197.652691:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652697:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652704:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac7d1db00) 00010000:00010000:1.0:1784938197.652707:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938197.652710:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652725:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec4394 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652744:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652751:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652757:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652762:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938197.652765:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652770:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652778:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938197.652780:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938197.652782:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.652787:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec439b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938197.652911:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af537aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:11507:x1871643048756736:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 4752us (15002us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938197.652924:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:0.0:1784938197.723887:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.723996:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048756992 00000100:00100000:3.0:1784938197.724008:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048756992 00000100:00100000:3.0:1784938197.724095:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:3.0:1784938197.724108:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+24:11510:x1871643048756992:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938197.724147:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938197.724177:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43a2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b57 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.724351:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.724368:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.724382:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.724398:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.724405:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.724411:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726389:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726414:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726429:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938197.726444:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1784938197.726592:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726600:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726621:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726627:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.726632:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726641:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726656:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938197.726659:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.726665:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726671:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec43a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726689:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726697:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726703:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726707:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.726710:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726727:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726736:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac3861000) 00010000:00010000:2.0:1784938197.726739:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.726742:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726748:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726808:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43a2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726824:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 26 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.726832:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938197.726834:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938197.726837:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938197.726924:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11510:x1871643048756992:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2818us (3049us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1784938197.726935:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:2.0:1784938197.732636:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.732711:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048757120 00000100:00100000:3.0:1784938197.732726:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048757120 00000100:00100000:3.0:1784938197.732933:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:3.0:1784938197.732945:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11510:x1871643048757120:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784938197.733045:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733066:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733079:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733149:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733164:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733171:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733178:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938197.733183:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733191:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733206:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:3.0:1784938197.733210:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938197.733239:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.733247:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938197.733350:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11510:x1871643048757120:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 406us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938197.733358:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:0.0:1784938197.735726:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.735828:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048757376 00000100:00100000:3.0:1784938197.735842:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048757376 00000100:00100000:3.0:1784938197.735913:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1784938197.735942:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11510:x1871643048757376:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784938197.736316:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:11510:x1871643048757376:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 374us (602us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1784938197.736325:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1784938197.765142:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.765270:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048757632 00000100:00100000:3.0:1784938197.765283:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048757632 00000100:00100000:3.0:1784938197.765419:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:3.0:1784938197.765432:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:11037:x1871643048757632:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938197.765478:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938197.765508:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b5e expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.765764:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.765784:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.765794:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.765836:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.765852:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 28 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938197.765869:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065529216:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938197.766010:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac879e300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938197.768843:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065529216:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938197.768882:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938197.772978:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938197.773255:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048757760 00000100:00100000:2.0:1784938197.773268:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048757760 00010000:00010000:2.0:1784938197.773326:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 29 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938197.773399:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:2.0:1784938197.773411:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:2356:x1871643048757760:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938197.773442:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938197.773452:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 29 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.773484:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 29 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.773513:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b57 expref: 29 pid: 5806 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.773538:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938197.773544:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.773556:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.773565:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.773598:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938197.773796:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:2356:x1871643048757760:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 386us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938197.773805:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00010000:00010000:3.0:1784938197.774144:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.774163:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938197.774188:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1784938197.774435:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 29 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.774455:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 28 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.774477:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:3.0:1784938197.774480:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1784938197.774483:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87d400, rc 0) 00000100:00100000:3.0:1784938197.774521:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:11037:x1871643048757632:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9093us (9406us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1784938197.774529:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:0.0:1784938197.781652:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938197.781813:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758016 00000100:00100000:1.0:1784938197.781827:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758016 00000100:00100000:1.0:1784938197.781923:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:1.0:1784938197.781933:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:11037:x1871643048758016:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:1.0:1784938197.782627:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.782649:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.782663:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938197.782727:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1784938197.782872:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000055b4ec2b reply state 00000000ba0cd23e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938197.782884:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1784938197.782949:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1784938197.783141:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11037:x1871643048758016:12345-192.168.201.58@tcp:36:bash.0 Request processed in 1198us (1491us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1784938197.783158:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 192 00000020:00080000:1.0:1784938197.783165:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1784938197.788013:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1784938197.788430:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.788448:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.788490:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.788497:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938197.788503:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.788512:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.788533:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:3.0:1784938197.788536:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938197.788542:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.788559:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec43e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938197.788720:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758144 00000100:00100000:2.0:1784938197.788813:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758144 00000100:00100000:2.0:1784938197.788932:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:2.0:1784938197.788944:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:11037:x1871643048758144:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938197.788978:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938197.789001:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b65 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.789077:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b65 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.789093:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b65 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.789115:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938197.789118:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938197.789121:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938197.789428:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11037:x1871643048758144:12345-192.168.201.58@tcp:101:bash.0 Request processed in 485us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938197.789436:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:0.0:1784938197.792519:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938197.792718:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758272 00000100:00100000:2.0:1784938197.792732:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758272 00000100:00100000:2.0:1784938197.792926:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:2.0:1784938197.792939:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:11037:x1871643048758272:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938197.792966:0:6605:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938197.792999:0:6605:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b6c expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938197.793065:0:6605:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a63fed2, atime: 0x6a63fed1, ctime: 0x6a63fed2, blocks: 0xb 00010000:00010000:2.0:1784938197.793096:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=406s v=(0 0) 00010000:00010000:2.0:1784938197.793101:0:6605:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938197.793112:0:6605:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.793145:0:6605:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 8 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.793162:0:6605:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938197.793329:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:11037:x1871643048758272:12345-192.168.201.58@tcp:101:bash.0 Request processed in 392us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938197.793337:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00080000:3.0:1784938197.793407:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938197.796449:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938197.796620:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758400 00000100:00100000:1.0:1784938197.796634:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758400 00002000:00010000:1.0:1784938197.796691:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1784938197.796696:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05af4fb4380 with x1871643048758400 ext(0->18446744073709551615) 00002000:00010000:1.0:1784938197.796714:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05af4fb4380. 00000100:00100000:1.0:1784938197.796861:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784938197.796875:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2358:x1871643048758400:12345-192.168.201.58@tcp:10:bash.0 00002000:00010000:1.0:1784938197.797415:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1784938197.797420:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1784938194 -> 1784938198 00002000:00010000:1.0:1784938197.797423:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1784938193 -> 1784938193 00002000:00010000:1.0:1784938197.797425:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1784938194 -> 1784938198 00002000:00010000:1.0:1784938197.797427:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1784938197.797813:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2358:x1871643048758400:12345-192.168.201.58@tcp:10:bash.0 Request processed in 936us (1375us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1784938197.797823:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00002000:00010000:1.0:1784938197.797828:0:6608:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1784938197.797831:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05af4fb4380 with x1871643048758400 ext(0->18446744073709551615) 00002000:00010000:1.0:1784938197.797837:0:6608:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05af4fb4380. 00000100:00100000:1.0:1784938197.863805:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.863909:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758528 00000100:00100000:3.0:1784938197.863923:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758528 00000100:00100000:3.0:1784938197.864095:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 194 00000100:00100000:3.0:1784938197.864109:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11524:x1871643048758528:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784938197.864302:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.864324:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.864338:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.864374:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.864382:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.864389:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.865106:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.865118:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.865126:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938197.866339:0:5805:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866365:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866373:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866380:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866387:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.866393:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866423:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866443:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938197.866447:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.866454:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.866527:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec43f6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867064:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867073:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867080:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867085:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.867089:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867095:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867106:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac3861b00) 00010000:00010000:2.0:1784938197.867109:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.867113:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867135:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec43fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867373:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867381:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867386:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867390:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.867393:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867398:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867408:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938197.867410:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.867414:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.867420:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4404 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938197.867637:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11524:x1871643048758528:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 3524us (3903us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938197.867650:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 194 00010000:00010000:0.0:1784938197.874454:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938197.902057:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.902255:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758784 00000100:00100000:3.0:1784938197.902269:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758784 00000100:00100000:2.0:1784938197.902717:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:2.0:1784938197.902731:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+32:11527:x1871643048758784:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938197.902761:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938197.902805:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec440b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b73 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.902899:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.902919:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.902945:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.902964:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.902971:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.902978:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903410:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903421:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903430:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938197.903449:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1784938197.903583:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903592:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903599:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903606:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.903611:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903620:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903635:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938197.903639:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.903651:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903658:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4412 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903672:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903678:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903694:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903698:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938197.903701:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903708:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903717:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b200) 00010000:00010000:2.0:1784938197.903720:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938197.903723:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903729:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903778:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec440b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b73 expref: 35 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903793:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b73 expref: 34 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938197.903800:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938197.903802:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784938197.903805:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938197.903904:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee358000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:11527:x1871643048758784:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1175us (1861us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1784938197.903923:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:0.0:1784938197.908209:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938197.908436:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048758912 00000100:00100000:1.0:1784938197.908446:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048758912 00000100:00100000:1.0:1784938197.908554:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:1.0:1784938197.908564:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:11527:x1871643048758912:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:1.0:1784938197.908653:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.908674:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 34 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.908683:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.908720:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 34 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.908755:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 34 pid: 7211 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938197.908772:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065529344:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938197.908893:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7da4300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938197.911615:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065529344:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938197.911656:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938197.922594:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938197.922845:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048759168 00000100:00100000:3.0:1784938197.922857:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048759168 00000100:00100000:3.0:1784938197.922963:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:3.0:1784938197.922975:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:5571:x1871643048759168:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1784938197.923542:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:5571:x1871643048759168:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 566us (958us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1784938197.923559:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784938197.928026:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938197.928489:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048759296 00000100:00100000:1.0:1784938197.928503:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048759296 00010000:00010000:1.0:1784938197.928682:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 36 pid: 7211 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938197.928775:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:1.0:1784938197.928788:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:2355:x1871643048759296:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938197.928810:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938197.928818:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 36 pid: 7211 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.928834:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 36 pid: 7211 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.928860:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec43d3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b5e expref: 36 pid: 7211 timeout: 506 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.928901:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:1.0:1784938197.928907:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.928918:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.928927:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938197.929011:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938197.929093:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:2355:x1871643048759296:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 306us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938197.929101:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00010000:00010000:3.0:1784938197.930447:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.930495:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.930542:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.932700:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.932710:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.932716:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938197.932723:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.932733:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.932757:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:3.0:1784938197.932760:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938197.932766:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938197.932772:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec442e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938197.932913:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:11527:x1871643048758912:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 24344us (24714us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938197.932925:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:0.0:1784938197.937420:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938197.937651:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048759552 00000100:00100000:1.0:1784938197.937666:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048759552 00000100:00100000:1.0:1784938197.937742:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1784938197.937753:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+34:11527:x1871643048759552:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1784938197.938087:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:11527:x1871643048759552:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 335us (682us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1784938197.938096:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:0.0:1784938198.046315:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938198.046436:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048759808 00000100:00100000:1.0:1784938198.046450:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048759808 00000100:00100000:1.0:1784938198.046570:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:1.0:1784938198.046581:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+35:11538:x1871643048759808:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:1.0:1784938198.046616:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938198.046666:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec4435 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b7a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.046960:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.046980:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.046995:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047011:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047017:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047023:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047480:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec444a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047491:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec444a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047498:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec444a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938198.047510:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1784938198.047770:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047790:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047796:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047802:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938198.047807:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047815:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047831:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:1.0:1784938198.047835:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938198.047841:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047847:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec443c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047864:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047870:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047876:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047881:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938198.047890:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047897:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047905:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938198.047908:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938198.047911:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047917:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec4443 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047973:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990400/0xea86628a8aec4435 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b7a expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047988:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec444a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b7a expref: 37 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.047998:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:1.0:1784938198.048000:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938198.048004:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990000, rc 0) 00000100:00100000:1.0:1784938198.048275:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:11538:x1871643048759808:12345-192.168.201.58@tcp:101:cat.0 Request processed in 1693us (1973us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1784938198.048286:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:2.0:1784938198.060952:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938198.065424:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048760064 00000100:00100000:1.0:1784938198.065450:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048760064 00000100:00100000:1.0:1784938198.065605:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:1.0:1784938198.065619:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:11538:x1871643048760064:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:1.0:1784938198.067577:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:11538:x1871643048760064:12345-192.168.201.58@tcp:35:cat.0 Request processed in 1947us (6632us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1784938198.067593:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:0.0:1784938198.099870:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.100058:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048760320 00000100:00100000:2.0:1784938198.100073:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048760320 00000100:00100000:2.0:1784938198.100157:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 198 00000100:00100000:2.0:1784938198.100171:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:11539:x1871643048760320:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:2.0:1784938198.100292:0:5805:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1784938198.100333:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec444a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b7a expref: 38 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100361:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b73 expref: 37 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100376:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec43e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b65 expref: 36 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100388:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938198.100403:0:5805:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938198.100429:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100447:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100457:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100490:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100507:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100515:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100937:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100946:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.100954:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938198.101715:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1784938198.106240:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 407049021035ns, next at 408044510002ns, rc = 0 00010000:00010000:2.0:1784938198.106436:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.106472:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.106488:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.106498:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.106504:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.106550:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.106579:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938198.107252:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938198.107262:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.107270:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938198.107275:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.107285:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.107302:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:1.0:1784938198.107306:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938198.107312:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.107318:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec446d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.107337:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938198.107339:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938198.107342:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938198.107488:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.107498:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.107505:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.107511:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.107515:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.107521:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.107531:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938198.107534:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1784938198.107536:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108195:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4466 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108271:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108280:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108304:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108309:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.108313:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108320:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108331:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938198.108334:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938198.108337:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.108342:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4458 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938198.108356:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f74eb1dd reply state 000000009108493c transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.108366:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938198.108589:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+37:11539:x1871643048760320:12345-192.168.201.58@tcp:36:rm.0 Request processed in 8414us (8725us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1784938198.108612:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 198 00010000:00010000:3.0:1784938198.116303:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.116328:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.116337:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.116344:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938198.116350:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.116359:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.116381:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b200) 00010000:00010000:3.0:1784938198.116385:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938198.116392:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.116399:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec445f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938198.166305:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.166429:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048760576 00000100:00100000:2.0:1784938198.166441:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048760576 00000100:00100000:2.0:1784938198.166533:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:2.0:1784938198.166549:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+36:11545:x1871643048760576:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938198.166621:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.166652:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4474 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b81 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.166824:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.166842:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.166855:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.166871:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.166878:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.166884:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938198.167592:0:7211:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1784938198.167787:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167799:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167810:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167866:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167875:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167883:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167890:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.167895:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167904:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167918:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938198.167921:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938198.167926:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.167933:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec447b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938198.167948:0:7211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005188c0c1 reply state 00000000a0b7363e transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.167959:0:7211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938198.167992:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4474 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 39 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.168020:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 38 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.168028:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938198.168031:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938198.168033:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938198.168121:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2827800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11545:x1871643048760576:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1573us (1830us total) trans 4294967482 rc 0/0 00000100:00100000:2.0:1784938198.168132:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:0.0:1784938198.173065:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.173160:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048760704 00000100:00100000:2.0:1784938198.173174:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048760704 00000100:00100000:2.0:1784938198.173309:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1784938198.173322:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048760704:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938198.173345:0:8127:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.173374:0:8127:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b88 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938198.173413:0:8127:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1784938198.173443:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=407s v=(0 0) 00010000:00010000:2.0:1784938198.173449:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938198.173470:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 6 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.173494:0:8127:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 6 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.173550:0:8127:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938198.173620:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2355:x1871643048760704:12345-192.168.201.58@tcp:101:bash.0 Request processed in 301us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.173629:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00080000:0.0:1784938198.173885:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1784938198.174395:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.174408:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.174416:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.174439:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938198.174445:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.174455:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.174486:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886be00) 00010000:00010000:3.0:1784938198.174490:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938198.174496:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.174505:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4482 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938198.177637:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.177746:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048760832 00000100:00100000:3.0:1784938198.177759:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048760832 00000100:00100000:3.0:1784938198.177834:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:3.0:1784938198.177846:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:11545:x1871643048760832:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1784938198.177873:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938198.177898:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b8f expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.177939:0:6602:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.177949:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938198.177955:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938198.177980:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.178025:0:6602:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.178043:0:6602:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.178060:0:6602:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1871643065529472:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938198.178187:0:6602:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938198.182706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.183075:0:6602:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6602:1871643065529472:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938198.183120:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 7 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.183159:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c400, rc 0) 00000100:00100000:3.0:1784938198.183261:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:11545:x1871643048760832:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5416us (5639us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.183273:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1784938198.183634:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048760960 00000100:00100000:1.0:1784938198.183643:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048760960 00010000:00010000:1.0:1784938198.183685:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938198.183873:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:1.0:1784938198.183884:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048760960:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938198.183902:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938198.183929:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.183944:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.183972:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4497 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b88 expref: 7 pid: 8127 timeout: 507 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.183989:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938198.183994:0:5792:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938198.184004:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.184016:0:5792:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.184058:0:5792:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938198.184075:0:5792:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5792:1871643065529600:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784938198.184326:0:5792:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7da4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938198.190006:0:5792:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5792:1871643065529600:192.168.201.58@tcp:105: 00010000:00010000:1.0:1784938198.190048:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938198.190124:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048760960:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 6240us (7431us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938198.190138:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:0.0:1784938198.192093:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.192363:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048761216 00000100:00100000:3.0:1784938198.192376:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048761216 00000100:00100000:3.0:1784938198.192494:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:3.0:1784938198.192506:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+38:11545:x1871643048761216:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1784938198.193092:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11545:x1871643048761216:12345-192.168.201.58@tcp:35:bash.0 Request processed in 584us (1007us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1784938198.193124:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:0.0:1784938198.328599:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.329288:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048761344 00000100:00100000:3.0:1784938198.329310:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048761344 00000100:00100000:3.0:1784938198.329380:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:3.0:1784938198.329392:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+39:11561:x1871643048761344:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938198.329429:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938198.329467:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b96 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.329546:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec44ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.329560:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec44ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.329571:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec44ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938198.329646:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1784938198.329650:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938198.329680:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec44ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.329710:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b96 expref: 41 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.329733:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec44ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b96 expref: 40 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.329766:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:3.0:1784938198.329770:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938198.329774:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87de00, rc 0) 00000100:00100000:3.0:1784938198.329849:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+40:11561:x1871643048761344:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 459us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.329857:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:0.0:1784938198.336778:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.337367:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048761600 00000100:00100000:2.0:1784938198.337393:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048761600 00000100:00100000:2.0:1784938198.337488:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:2.0:1784938198.337500:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+40:11561:x1871643048761600:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938198.337532:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.337560:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec44b3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897b9d expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.337691:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec44ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.337854:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec44ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.337870:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec44ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938198.337882:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784938198.338036:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec44b3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b9d expref: 43 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.338051:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec44ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b9d expref: 42 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.338079:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938198.338081:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938198.338085:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938198.338154:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+42:11561:x1871643048761600:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 657us (1392us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1784938198.338163:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:0.0:1784938198.344270:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.344339:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048761856 00000100:00100000:2.0:1784938198.344353:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048761856 00000100:00100000:0.0:1784938198.344398:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.344973:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:2.0:1784938198.344991:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+42:11561:x1871643048761856:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938198.345027:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.345323:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec44c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ba4 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.345630:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec44cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.345648:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec44cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.345661:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec44cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938198.345679:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784938198.345971:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec44c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ba4 expref: 45 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.346020:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec44cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ba4 expref: 44 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.346029:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:2.0:1784938198.346032:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1784938198.346036:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938198.346129:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:11561:x1871643048761856:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1144us (1927us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1784938198.346139:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:1.0:1784938198.346617:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048761984 00000100:00100000:1.0:1784938198.346628:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048761984 00000100:00100000:1.0:1784938198.346691:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1784938198.346701:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+44:2358:x1871643048761984:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938198.346718:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938198.346740:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec44ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b9d expref: 44 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.346756:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:1.0:1784938198.346760:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938198.346788:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+43:2358:x1871643048761984:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 89us (2390us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938198.346795:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784938198.356687:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.357013:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048762112 00000100:00100000:2.0:1784938198.357028:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048762112 00000100:00100000:2.0:1784938198.357168:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1784938198.357182:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+6:2356:x1871643048762112:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:2.0:1784938198.357297:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.357325:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.357335:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938198.357340:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938198.357345:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.357401:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 6 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.357439:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 6 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.357468:0:8127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1871643065529728:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938198.357580:0:8127:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938198.360872:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.361304:0:8127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8127:1871643065529728:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938198.361343:0:8127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.361595:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048762240 00000100:00100000:3.0:1784938198.361612:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048762240 00002000:00100000:3.0:1784938198.361679:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa05af4fbdf80 x1871643048762240/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:429/0 lens 504/0 e 0 to 0 dl 1784938209 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938198.361689:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05af4fbdf80 with x1871643048762240 ext(0->8) 00010000:00010000:3.0:1784938198.361697:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 7 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.361711:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 7 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938198.361719:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05af4fbdf80 00000100:00100000:3.0:1784938198.361852:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1784938198.361863:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048762240:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:3.0:1784938198.363157:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2356:x1871643048762240:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 1286us (2290us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1784938198.363170:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00002000:00100000:3.0:1784938198.363180:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffffa05af4fbdf80 x1871643048762240/t4294967308(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:429/0 lens 504/448 e 0 to 0 dl 1784938209 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938198.363234:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05af4fbdf80 with x1871643048762240 ext(0->8) 00010000:00010000:3.0:1784938198.363244:0:6610:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 9 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.363263:0:6610:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 9 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938198.363271:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffffa05af4fbdf80 00000100:00100000:0.0:1784938198.372555:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.372685:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048762368 00000100:00100000:2.0:1784938198.372700:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048762368 00010000:00010000:2.0:1784938198.372844:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 9 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.372907:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1784938198.372919:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2357:x1871643048762368:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938198.372947:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1784938198.372973:0:5791:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1784938198.372977:0:5791:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1784938199 00002000:00010000:2.0:1784938198.372979:0:5791:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1784938199 00002000:00010000:2.0:1784938198.372982:0:5791:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1784938199 00010000:00010000:2.0:1784938198.372989:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 9 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.373028:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 9 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.373056:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1ac5562/0xea86628a8aec449e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b8f expref: 9 pid: 6602 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.373079:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938198.373084:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938198.373091:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.373102:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.373325:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938198.373401:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2357:x1871643048762368:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 483us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.373411:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00010000:00010000:3.0:1784938198.374581:0:8127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374600:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374641:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374650:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374658:0:8127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374665:0:8127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938198.374671:0:8127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374696:0:8127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374717:0:8127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.374853:0:8127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec44dd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.375069:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048762112:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 17884us (18393us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.375081:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1784938198.381738:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938198.381850:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048762624 00000100:00100000:1.0:1784938198.381870:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048762624 00000100:00100000:1.0:1784938198.381947:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1784938198.381959:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+43:11561:x1871643048762624:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:1.0:1784938198.382047:0:5807:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec44cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ba4 expref: 43 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938198.383471:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1784938198.383546:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1784938198.384046:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1784938198.384119:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.384143:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 47 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.384155:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.384207:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 47 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.388916:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 47 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938198.388945:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1871643065529856:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938198.389088:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7da46c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938198.391482:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5807:1871643065529856:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938198.391521:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938198.396879:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938198.397314:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048762752 00000100:00100000:1.0:1784938198.397328:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048762752 00010000:00010000:1.0:1784938198.397385:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 48 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938198.397522:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:1.0:1784938198.397543:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+48:2355:x1871643048762752:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938198.397569:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938198.397579:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 48 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.397594:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 48 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.397623:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4489 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b81 expref: 48 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.397643:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:1.0:1784938198.397651:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.397662:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.397672:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.397711:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938198.397794:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+47:2355:x1871643048762752:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 262us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938198.397802:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00010000:00010000:3.0:1784938198.397873:0:5807:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.397883:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938198.398051:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1784938198.398340:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1784938198.398496:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065529984:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784938198.398571:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1bd6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938198.401988:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938198.403163:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065529984 00000100:00100000:3.0:1784938198.403179:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065529984 00000100:00100000:3.0:1784938198.403300:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:3.0:1784938198.403313:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065529984:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784938198.403507:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065529984:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 Request processed in 197us (1534us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.403516:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:0.0:1784938198.404074:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065529984:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784938198.404930:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1784938198.405043:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065530112:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1784938198.405135:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63600 going to sleep for 11 seconds 00000100:00100000:0.0:1784938198.405326:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938198.405577:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065530112 00000100:00100000:3.0:1784938198.405586:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065530112 00000100:00100000:3.0:1784938198.405645:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:3.0:1784938198.405656:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5807:x1871643065530112:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1784938198.405891:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5807:x1871643065530112:12345-192.168.201.158@tcp:1000:mdt_rdpg00_000.0 Request processed in 235us (564us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1784938198.405900:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:0.0:1784938198.406921:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5807:1871643065530112:192.168.201.158@tcp:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1784938198.407039:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1784938198.407106:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.407119:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.407141:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.407147:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938198.407152:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.407162:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.407181:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:0.0:1784938198.407185:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1784938198.408500:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.408519:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec44e4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5807 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938198.409857:0:5807:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1784938198.409989:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1784938198.410005:0:5807:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 407352788977ns, next at 408352785504ns, rc = 0 00000001:00080000:0.0:1784938198.410016:0:5807:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1784938198.410080:0:5807:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ad886bd00) 00010000:00010000:0.0:1784938198.410085:0:5807:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1784938198.410097:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec44cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ba4 expref: 51 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938198.412022:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:11561:x1871643048762624:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 30048us (30294us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1784938198.412067:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000020:00080000:0.0:1784938198.412078:0:5807:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1784938198.421381:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938198.421503:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048762880 00000100:00100000:1.0:1784938198.421535:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048762880 00000100:00100000:1.0:1784938198.421606:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:1.0:1784938198.421619:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+50:11561:x1871643048762880:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784938198.421654:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938198.421686:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec44eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.421785:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec44eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bab expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.421805:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec44eb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bab expref: 51 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.421829:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938198.421833:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938198.421837:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990e00, rc 0) 00000100:00100000:1.0:1784938198.421917:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:11561:x1871643048762880:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 301us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938198.421925:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:2.0:1784938198.425963:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938198.426055:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048763136 00000100:00100000:0.0:1784938198.426067:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048763136 00000100:00100000:0.0:1784938198.426130:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:0.0:1784938198.426139:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+51:11561:x1871643048763136:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938198.426675:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:11561:x1871643048763136:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 534us (727us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1784938198.426685:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:0.0:1784938198.518350:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.518422:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048763264 00000100:00100000:3.0:1784938198.518437:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048763264 00000100:00100000:3.0:1784938198.518790:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:3.0:1784938198.518803:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:11571:x1871643048763264:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1784938198.518930:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.518953:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.518967:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.518984:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.518992:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519020:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519170:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519180:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519187:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1784938198.519281:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519297:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519304:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519312:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519318:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938198.519324:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519333:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519347:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:3.0:1784938198.519356:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938198.519362:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519371:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec44f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519388:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519395:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519401:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519407:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ca00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938198.519410:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519416:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519424:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ac3861500) 00010000:00010000:3.0:1784938198.519427:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938198.519430:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519436:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec44f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519466:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519480:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519485:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519490:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938198.519493:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519499:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519507:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:3.0:1784938198.519510:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938198.519513:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.519519:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4500 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.519625:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:11571:x1871643048763264:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 822us (1287us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.519636:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:1.0:1784938198.561211:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.561387:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048763520 00000100:00100000:2.0:1784938198.561400:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048763520 00000100:00100000:2.0:1784938198.561579:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:2.0:1784938198.561593:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+52:11574:x1871643048763520:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938198.561633:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.561665:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bb2 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.561789:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.561808:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.561824:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.561841:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.561849:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.561856:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562027:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562038:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562046:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938198.562058:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1784938198.562355:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562365:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562380:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562387:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.562393:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562403:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562419:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938198.562423:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938198.562428:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562436:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec450e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562528:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562537:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562544:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562550:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.562554:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562571:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562580:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886bb00) 00010000:00010000:2.0:1784938198.562583:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938198.562586:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562593:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562642:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562659:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 54 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.562667:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.562670:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938198.562672:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938198.562807:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11574:x1871643048763520:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1216us (1725us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1784938198.562817:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:0.0:1784938198.566899:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.566994:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048763648 00000100:00100000:2.0:1784938198.567007:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048763648 00000100:00100000:2.0:1784938198.567082:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:2.0:1784938198.567103:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11574:x1871643048763648:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1784938198.567260:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567281:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567294:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567330:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567337:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567344:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567351:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.567356:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567364:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567378:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.567382:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938198.567387:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.567394:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec452a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.567512:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11574:x1871643048763648:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 419us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.567523:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:1.0:1784938198.571193:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938198.571895:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048763904 00000100:00100000:0.0:1784938198.571909:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048763904 00000100:00100000:0.0:1784938198.572013:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:0.0:1784938198.572025:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+54:11574:x1871643048763904:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938198.572368:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11574:x1871643048763904:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 344us (1188us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1784938198.572377:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:1.0:1784938198.651600:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938198.651768:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048764160 00000100:00100000:0.0:1784938198.651783:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048764160 00000100:00100000:0.0:1784938198.651863:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:0.0:1784938198.651875:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11584:x1871643048764160:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938198.651909:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938198.651913:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1784938198.651969:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87de00/0xea86628a8aec44ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b96 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.651997:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:0.0:1784938198.652003:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938198.652024:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4531 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bb9 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.652175:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.652193:0:7211:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.652203:0:7211:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.652304:0:7211:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 55 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.652321:0:7211:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 55 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938198.652339:0:7211:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afb420a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065530240:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938198.652458:0:7211:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938198.656985:0:7211:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afb420a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7211:1871643065530240:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938198.657027:0:7211:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938198.659084:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938198.660014:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048764288 00000100:00100000:0.0:1784938198.660030:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048764288 00010000:00010000:0.0:1784938198.660088:0:5792:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 56 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938198.660325:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:0.0:1784938198.660338:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+56:2355:x1871643048764288:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938198.660361:0:5792:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938198.660370:0:5792:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 56 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.660386:0:5792:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 56 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.660416:0:5792:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec451c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb2 expref: 56 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.660436:0:5792:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:0.0:1784938198.660442:0:5792:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.660466:0:5792:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.660477:0:5792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.660520:0:5792:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938198.660636:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:2355:x1871643048764288:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 301us (1565us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938198.660645:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00010000:00010000:1.0:1784938198.660958:0:7211:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.660969:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938198.661005:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1784938198.661374:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec4531 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 56 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.661398:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 55 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.661408:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938198.661412:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784938198.661415:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:1.0:1784938198.661474:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11584:x1871643048764160:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9601us (9890us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1784938198.661484:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:1.0:1784938198.666985:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.667475:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048764544 00000100:00100000:2.0:1784938198.667489:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048764544 00000100:00100000:2.0:1784938198.667580:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 208 00000100:00100000:2.0:1784938198.667591:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+55:11584:x1871643048764544:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:2.0:1784938198.668016:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.668039:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.668054:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938198.668461:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1784938198.668496:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000f3e2760 reply state 000000008da52028 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.668509:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1784938198.668637:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11584:x1871643048764544:12345-192.168.201.58@tcp:36:bash.0 Request processed in 1044us (1665us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1784938198.668646:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 208 00000020:00080000:2.0:1784938198.668653:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784938198.671958:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:1.0:1784938198.672052:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.672067:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.672076:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.672082:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938198.672088:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.672106:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.672153:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938198.672156:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938198.672163:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938198.672170:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.672495:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048764672 00000100:00100000:2.0:1784938198.672509:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048764672 00000100:00100000:2.0:1784938198.672573:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:2.0:1784938198.672584:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11584:x1871643048764672:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938198.672622:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.672643:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec454d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bc0 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.672741:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.672756:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 58 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.672765:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.672803:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 58 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.672817:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 58 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.672832:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee358a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065530368:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938198.673141:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938198.679040:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.679483:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048764800 00000100:00100000:3.0:1784938198.679496:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048764800 00010000:00010000:3.0:1784938198.679560:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 59 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.679640:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1784938198.679652:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:2356:x1871643048764800:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938198.679671:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938198.679681:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 59 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.679696:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 59 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.679726:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:3.0:1784938198.679733:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.679744:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.679753:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.679777:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938198.679855:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:2356:x1871643048764800:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 205us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.679864:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00010000:00010000:2.0:1784938198.681518:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec4538 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bb9 expref: 58 pid: 7211 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938198.681759:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee358a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065530368:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938198.681793:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.681830:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.681837:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938198.681902:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784938198.681907:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938198.681934:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.681976:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec454d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 58 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.681991:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 57 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.682000:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.682003:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938198.682008:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938198.682328:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11584:x1871643048764672:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9743us (10379us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.682340:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:1.0:1784938198.687161:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.687294:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048765056 00000100:00100000:2.0:1784938198.687308:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048765056 00000100:00100000:2.0:1784938198.687374:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1784938198.687386:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+57:11584:x1871643048765056:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:2.0:1784938198.687727:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11584:x1871643048765056:12345-192.168.201.58@tcp:35:bash.0 Request processed in 342us (580us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1784938198.687754:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1784938198.754938:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938198.755082:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048765184 00000100:00100000:3.0:1784938198.755107:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048765184 00000100:00100000:3.0:1784938198.755193:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:3.0:1784938198.755205:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+58:11590:x1871643048765184:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938198.755309:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938198.755339:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec455b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bc7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.755427:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.755445:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.755470:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938198.755548:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1784938198.755553:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938198.755580:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.755757:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec455b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc7 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.755783:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc7 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.755794:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:3.0:1784938198.755798:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938198.755803:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c400, rc 0) 00000100:00100000:3.0:1784938198.755886:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048765184:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 682us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.755894:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:1.0:1784938198.760742:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.760911:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048765312 00000100:00100000:2.0:1784938198.760925:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048765312 00000100:00100000:2.0:1784938198.761001:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:2.0:1784938198.761013:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048765312:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938198.761042:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.761067:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bce expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761172:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761191:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761203:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761265:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761274:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761282:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761399:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761433:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761441:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938198.761503:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784938198.761509:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938198.761536:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761550:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761563:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761570:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761577:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761584:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.761589:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761597:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761764:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938198.761768:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938198.761780:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761787:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761804:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761811:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761817:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761822:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938198.761824:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761830:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761839:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886b300) 00010000:00010000:2.0:1784938198.761841:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938198.761843:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761849:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761883:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec4569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bce expref: 61 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761909:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bce expref: 60 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.761916:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.761918:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938198.761921:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938198.762040:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11590:x1871643048765312:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1028us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.762049:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:1.0:1784938198.768643:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938198.768696:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.768772:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048765696 00000100:00100000:2.0:1784938198.768786:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048765696 00000100:00100000:2.0:1784938198.768871:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1784938198.768883:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae8ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:2355:x1871643048765696:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1784938198.768906:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938198.768938:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec457e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bce expref: 60 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.768964:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.768970:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938198.769043:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae8ea3450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:2355:x1871643048765696:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 162us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.769052:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1784938198.770737:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048765568 00000100:00100000:3.0:1784938198.770753:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048765568 00000100:00100000:3.0:1784938198.770829:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:3.0:1784938198.770839:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048765568:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938198.770866:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938198.770902:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec4585 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bd5 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.771034:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.771047:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.771054:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.771127:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.771142:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 60 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.771159:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065530496:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938198.772774:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac879ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938198.774649:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.774915:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc95c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065530496:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938198.774953:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.775274:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048765824 00000100:00100000:3.0:1784938198.775284:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048765824 00010000:00010000:3.0:1784938198.775332:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 61 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938198.775411:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784938198.775421:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:2355:x1871643048765824:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938198.775441:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938198.775461:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 61 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.775474:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 61 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.775502:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4554 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc0 expref: 61 pid: 5806 timeout: 507 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.775521:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:3.0:1784938198.775536:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.775548:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.775557:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938198.775592:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938198.775824:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.775832:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938198.775857:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1784938198.776050:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ca00/0xea86628a8aec4585 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.776069:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938198.776077:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:0.0:1784938198.776079:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1784938198.776082:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c800, rc 0) 00000100:00100000:0.0:1784938198.776153:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11590:x1871643048765568:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 5316us (7526us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1784938198.776162:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:3.0:1784938198.776285:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:2355:x1871643048765824:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 864us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938198.776293:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:0.0:1784938198.779544:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.779733:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766080 00000100:00100000:2.0:1784938198.779746:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766080 00000100:00100000:2.0:1784938198.779827:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1784938198.779838:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11590:x1871643048766080:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:2.0:1784938198.779859:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938198.779889:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990e00/0xea86628a8aec44eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bab expref: 60 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.779913:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.779919:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938198.779985:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048766080:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 149us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.779995:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:1.0:1784938198.782376:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.782500:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766208 00000100:00100000:2.0:1784938198.782513:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766208 00000100:00100000:2.0:1784938198.782590:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:2.0:1784938198.782601:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048766208:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:2.0:1784938198.782747:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.782770:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.782786:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938198.783016:0:7211:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:2.0:1784938198.783137:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048766208:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 537us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.783146:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:1.0:1784938198.785971:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938198.786084:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766336 00000100:00100000:2.0:1784938198.786097:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766336 00000100:00100000:2.0:1784938198.786279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:2.0:1784938198.786293:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+59:11590:x1871643048766336:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938198.786322:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938198.786350:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bdc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.786427:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.786440:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.786478:0:5805:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.786493:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.786511:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938198.786514:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938198.786518:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 60 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938198.786537:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893400, rc 0) 00000100:00100000:2.0:1784938198.786638:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11590:x1871643048766336:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 348us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938198.786646:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 214 00010000:00010000:0.0:1784938198.900599:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938199.537660:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938199.537673:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938199.537716:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1784938199.537736:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938199.537923:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065530624:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938199.539416:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938199.549846:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.550909:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766464 00000100:00100000:2.0:1784938199.550924:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766464 00000100:00100000:2.0:1784938199.551028:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:2.0:1784938199.551051:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766464:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784938199.551095:0:7211:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784938199.551274:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee235c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766464:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 234us (1441us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.551460:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00080000:3.0:1784938199.556783:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938199.557629:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.557803:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766592 00000100:00100000:2.0:1784938199.557816:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766592 00000100:00100000:2.0:1784938199.557894:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:2.0:1784938199.557906:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766592:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.558016:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558037:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558065:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558084:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558091:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558261:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558599:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558669:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558678:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938199.558730:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1784938199.558735:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938199.558752:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558767:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558774:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558781:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558788:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.558792:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558801:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558827:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:2.0:1784938199.558831:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938199.558837:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558844:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec45a8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558860:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558867:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558873:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558878:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.558880:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558886:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558894:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffffa05ad886b300) 00010000:00010000:2.0:1784938199.558897:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938199.558900:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558906:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45af lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558932:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558939:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558945:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558950:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.558953:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558959:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558967:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938199.558969:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938199.558972:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.558978:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.560257:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766592:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 2341us (2626us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.560270:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:0.0:1784938199.563759:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb7480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065530624:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938199.577049:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.577212:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766848 00000100:00100000:2.0:1784938199.577253:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766848 00000100:00100000:2.0:1784938199.577338:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:2.0:1784938199.577371:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+60:11591:x1871643048766848:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.577400:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938199.577431:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec45bd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897be3 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577607:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577638:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577654:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938199.577669:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784938199.577806:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577814:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577821:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577827:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.577833:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577841:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577856:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938199.577865:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1784938199.577873:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577879:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec45c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577941:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec45bd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897be3 expref: 62 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577953:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:2.0:1784938199.577955:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938199.577959:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec45bd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897be3 expref: 62 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.577970:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938199.578069:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766848:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 700us (1036us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1784938199.578078:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:3.0:1784938199.586504:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.586660:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048766976 00000100:00100000:2.0:1784938199.586674:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048766976 00000100:00100000:2.0:1784938199.586748:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:2.0:1784938199.586759:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766976:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784938199.586813:0:5805:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784938199.586976:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048766976:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 194us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.586984:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:3.0:1784938199.590835:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.591058:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048767232 00000100:00100000:2.0:1784938199.591103:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048767232 00000100:00100000:2.0:1784938199.591189:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:2.0:1784938199.591203:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048767232:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.591267:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938199.591271:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1784938199.591307:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bc7 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.591332:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:2.0:1784938199.591339:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938199.591358:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bea expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1784938199.591956:0:7211:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1784938199.592272:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.592292:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.592306:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.592380:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec45d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bea expref: 63 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.592400:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bea expref: 62 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.592430:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ad886b300) 00010000:00010000:2.0:1784938199.592446:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938199.592450:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893a00, rc 0) 00000100:00100000:2.0:1784938199.592541:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11591:x1871643048767232:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1340us (1722us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1784938199.592551:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:2.0:1784938199.602359:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065531008:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938199.602446:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065531136:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938199.602510:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938199.602510:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1784938199.602517:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065530880:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938199.602528:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065530752:0@lo:400:kworker.0 00000100:00100000:2.0:1784938199.602546:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065531392:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938199.602585:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938199.602618:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065531264:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938199.602643:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.602759:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938199.602798:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938199.602812:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938199.602815:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938199.602841:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938199.602986:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048767488 00000100:00100000:1.0:1784938199.602997:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048767488 00000100:00100000:1.0:1784938199.603059:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065531008 00000100:00100000:1.0:1784938199.603063:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065531008 00000100:00080000:1.0:1784938199.603090:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938199.603121:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065530880 00000100:00100000:1.0:1784938199.603125:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065530880 00000100:00100000:1.0:1784938199.603138:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065531264 00000100:00100000:1.0:1784938199.603141:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065531264 00000100:00080000:1.0:1784938199.603153:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938199.603172:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 163 00000100:00100000:1.0:1784938199.603189:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065531008:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938199.603271:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065531008:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 84us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.603482:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 163 00000100:00100000:1.0:1784938199.603625:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 164 00000100:00100000:1.0:1784938199.603632:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065530880:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938199.603661:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065530880:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 30us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.603667:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 164 00000100:00100000:1.0:1784938199.603724:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 165 00000100:00100000:1.0:1784938199.603730:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065531264:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938199.603753:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065531264:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.603760:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 165 00000100:00100000:1.0:1784938199.603839:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:1.0:1784938199.603846:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11591:x1871643048767488:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938199.603909:0:5806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938199.603942:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec45d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bea expref: 62 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.603966:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ad886b300) 00010000:00010000:1.0:1784938199.603978:0:5806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938199.604004:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.604033:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.604208:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.604269:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.604277:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938199.604393:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065531136 00000100:00100000:3.0:1784938199.604402:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065531136 00000100:00100000:3.0:1784938199.604468:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065531392 00000100:00100000:3.0:1784938199.604472:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065531392 00000100:00100000:3.0:1784938199.604500:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 93 00000100:00100000:3.0:1784938199.604509:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1871643065531136:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938199.604647:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065530752 00000100:00100000:0.0:1784938199.604652:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065530752 00000100:00100000:0.0:1784938199.604690:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1784938199.604698:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065530752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938199.604757:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065530752:12345-0@lo:400:kworker.0 Request processed in 60us (2171us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.604764:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:0.0:1784938199.604825:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938199.604830:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938199.604862:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 94 00000100:00100000:0.0:1784938199.604870:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3324:x1871643065531392:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938199.604914:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3324:x1871643065531392:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 45us (2071us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.604921:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 94 00010000:00010000:1.0:1784938199.605200:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605426:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605445:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605453:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605461:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938199.605467:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605475:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605490:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:1.0:1784938199.605509:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938199.605529:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605537:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990000/0xea86628a8aec45e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605554:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605561:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605567:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605573:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938199.605576:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605582:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605591:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb115eb89 (ffffa05ac7d1db00) 00010000:00010000:1.0:1784938199.605594:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938199.605597:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.605603:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec45ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb115eb89 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938199.605685:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048767488:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1837us (3039us total) trans 0 rc -2/-2 00000100:00100000:1.0:1784938199.605700:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:1.0:1784938199.605893:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee358a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065530752:0@lo:400:kworker.0 00000100:00100000:1.0:1784938199.605912:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee35b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065531264:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938199.605988:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065530880:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938199.606003:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065531008:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938199.607749:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1871643065531136:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 3228us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.607766:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 93 00000100:00100000:0.0:1784938199.609487:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065531136:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938199.609984:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065531392:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938199.615410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938199.615466:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048767616 00000100:00100000:0.0:1784938199.615480:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048767616 00000100:00100000:0.0:1784938199.616723:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:0.0:1784938199.616747:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+61:11591:x1871643048767616:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938199.616803:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938199.616835:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec45f5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bf1 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.616893:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.616911:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.616927:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.617069:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11a000/0xea86628a8aec45f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.617096:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.617115:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938199.617118:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1784938199.617123:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11b000, rc 0) 00000100:00100000:0.0:1784938199.617233:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee358e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11591:x1871643048767616:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 477us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.617243:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:1.0:1784938199.634983:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.635159:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048767872 00000100:00100000:2.0:1784938199.635171:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048767872 00000100:00100000:2.0:1784938199.635270:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:2.0:1784938199.635288:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+62:11591:x1871643048767872:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.635397:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.635416:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.635429:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938199.636066:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1784938199.636079:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 408578862560ns, next at 409578859963ns, rc = 0 00000004:00010000:3.0:1784938199.636181:0:5805:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d9f4c994 reply state 00000000208b002e transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938199.636192:0:5805:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938199.636488:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+64:11591:x1871643048767872:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1206us (1516us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1784938199.636498:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:3.0:1784938199.649118:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.649306:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048768000 00000100:00100000:1.0:1784938199.649321:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048768000 00000100:00100000:1.0:1784938199.649401:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 223 00000100:00100000:1.0:1784938199.649413:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+64:11591:x1871643048768000:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938199.649459:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938199.649490:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bf8 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.649708:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 65 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.649727:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 65 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.649752:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:1.0:1784938199.649756:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938199.649760:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991400, rc 0) 00000100:00100000:1.0:1784938199.649840:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+65:11591:x1871643048768000:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 429us (747us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.649865:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 223 00010000:00010000:0.0:1784938199.650813:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.650829:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.650850:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.650857:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938199.650862:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.650872:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.650889:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938199.650892:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938199.650898:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.650905:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4603 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.655616:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.656023:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048768128 00000100:00100000:1.0:1784938199.656038:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048768128 00000100:00100000:1.0:1784938199.656148:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:1.0:1784938199.656160:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afc8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2355:x1871643048768128:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1784938199.656797:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afc8d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2355:x1871643048768128:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 636us (1194us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1784938199.656807:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00080000:0.0:1784938199.657114:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938199.668967:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.669477:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048768384 00000100:00100000:2.0:1784938199.669494:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048768384 00000100:00100000:2.0:1784938199.669593:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:2.0:1784938199.669606:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+64:11591:x1871643048768384:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1784938199.670832:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+65:11591:x1871643048768384:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1218us (1872us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1784938199.670846:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1784938199.673860:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.679977:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048768640 00000100:00100000:3.0:1784938199.680003:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048768640 00000100:00100000:3.0:1784938199.680119:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:3.0:1784938199.680132:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+65:11591:x1871643048768640:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938199.680325:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+65:11591:x1871643048768640:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 194us (6479us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938199.680334:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:1.0:1784938199.682870:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.682983:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048768768 00000100:00100000:2.0:1784938199.682998:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048768768 00000100:00100000:2.0:1784938199.683076:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 225 00000100:00100000:2.0:1784938199.683089:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+65:11591:x1871643048768768:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.683118:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938199.683147:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4611 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897bff expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.683280:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4618 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.683297:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.683310:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938199.683360:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938199.683382:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4618 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.683446:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892600/0xea86628a8aec4611 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bff expref: 67 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.683469:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4618 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bff expref: 66 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.683478:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:2.0:1784938199.683481:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1784938199.683485:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938199.683558:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+66:11591:x1871643048768768:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 472us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.683567:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 225 00000100:00100000:0.0:1784938199.691352:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.691492:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048768896 00000100:00100000:3.0:1784938199.691506:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048768896 00000100:00100000:3.0:1784938199.691600:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:3.0:1784938199.691612:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+10:2356:x1871643048768896:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938199.691641:0:6602:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938199.691674:0:6602:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c06 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1784938199.691711:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63fed8, blocks: 0x1 00010000:00010000:3.0:1784938199.691740:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=408s v=(0 0) 00010000:00010000:3.0:1784938199.691746:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938199.691757:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.691783:0:6602:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 11 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.691825:0:6602:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87ce00, rc 0) 00000100:00100000:3.0:1784938199.691953:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:2356:x1871643048768896:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 342us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938199.691961:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:3.0:1784938199.700767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.700987:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769152 00000100:00100000:1.0:1784938199.701002:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769152 00000100:00100000:1.0:1784938199.701100:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:1.0:1784938199.701341:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+66:11591:x1871643048769152:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1784938199.701499:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+66:11591:x1871643048769152:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 164us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.701508:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:1.0:1784938199.704775:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938199.704896:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769280 00000100:00100000:0.0:1784938199.704909:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769280 00000100:00100000:0.0:1784938199.704984:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1784938199.704995:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:11591:x1871643048769280:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938199.705030:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938199.705302:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c0d expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.705346:0:6604:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.705372:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938199.705377:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938199.705383:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 12 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.705442:0:6604:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.705459:0:6604:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938199.705476:0:6604:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065531520:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938199.705815:0:6604:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe866c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938199.718370:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.718586:0:6604:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6604:1871643065531520:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938199.718633:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 12 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.718660:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05acb11a400, rc 0) 00000100:00100000:1.0:1784938199.718745:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:11591:x1871643048769280:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 13751us (13985us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.718774:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1784938199.718879:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769408 00000100:00100000:3.0:1784938199.718888:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769408 00010000:00010000:3.0:1784938199.718930:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938199.718968:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1784938199.718978:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+12:2356:x1871643048769408:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938199.718994:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938199.719025:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.719052:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.719090:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f20836fc/0xea86628a8aec461f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c06 expref: 12 pid: 6602 timeout: 508 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.719166:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938199.719173:0:5790:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938199.719190:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.719202:0:5790:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.719291:0:5790:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 11 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938199.719308:0:5790:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1871643065531648:192.168.201.58@tcp:105: 00000100:00100000:3.0:1784938199.719386:0:5790:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac879ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938199.741569:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.741708:0:5790:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc96a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5790:1871643065531648:192.168.201.58@tcp:105: 00010000:00010000:3.0:1784938199.741744:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938199.741826:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:2356:x1871643048769408:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 22848us (23469us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938199.741841:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1784938199.741954:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769536 00000100:00100000:1.0:1784938199.741964:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769536 00002000:00100000:1.0:1784938199.742029:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa059c2824380 x1871643048769536/t0(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:430/0 lens 504/0 e 0 to 0 dl 1784938210 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938199.742041:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa059c2824380 with x1871643048769536 ext(0->12) 00002000:00010000:1.0:1784938199.742048:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa059c2824380 00000100:00100000:1.0:1784938199.742091:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784938199.742100:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+11:2355:x1871643048769536:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1784938199.742718:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2824380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2355:x1871643048769536:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 616us (1163us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1784938199.742728:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00002000:00100000:1.0:1784938199.742736:0:6608:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffffa059c2824380 x1871643048769536/t4294967320(0) o4->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:430/0 lens 504/448 e 0 to 0 dl 1784938210 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1784938199.742744:0:6608:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa059c2824380 with x1871643048769536 ext(0->12) 00002000:00010000:1.0:1784938199.742748:0:6608:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa059c2824380 00000100:00100000:0.0:1784938199.747645:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.747803:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769664 00000100:00100000:2.0:1784938199.747815:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769664 00000100:00100000:2.0:1784938199.747884:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 227 00000100:00100000:2.0:1784938199.747896:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+66:11591:x1871643048769664:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1784938199.791901:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:0.0:1784938199.791929:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:0.0:1784938199.791958:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05afbe63900 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1784938199.791964:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05affe99400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05afbe63000 00000020:00080000:0.0:1784938199.791967:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05affe99300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05af5084c00 00000020:00080000:0.0:1784938199.791987:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05ac68de840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1784938199.791990:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05affe99200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05ac68dec00 00000020:00080000:0.0:1784938199.792015:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05affe99d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05af5255c00 00000001:00080000:0.0:1784938199.792059:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:0.0:1784938199.792092:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:0.0:1784938199.792134:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:0.0:1784938199.792159:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1784938199.792347:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1784938199.792609:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1784938199.792888:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938199.792919:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065531776:192.168.201.158@tcp:6:osp-syn-0-0.0 00000100:00100000:2.0:1784938199.793318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938199.793350:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065531776 00000100:00100000:2.0:1784938199.793359:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065531776 00000100:00100000:2.0:1784938199.793418:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 65 00000100:00100000:2.0:1784938199.793428:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1871643065531776:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 00002000:00080000:2.0:1784938199.793482:0:6602:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:2.0:1784938199.793537:0:6602:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a63fed7, atime: 0x6a63fed7, ctime: 0x6a63fed7, blocks: 0x1 00010000:00010000:2.0:1784938199.793547:0:6602:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.793589:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=408s v=(0 0) 00010000:00010000:2.0:1784938199.793594:0:6602:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938199.793612:0:6602:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.793635:0:6602:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.793647:0:6602:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.793655:0:6602:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.793675:0:6602:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1784938199.794293:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065531776:12345-192.168.201.158@tcp:6:osp-syn-0-0.0 Request processed in 861us (972us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1784938199.794304:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 65 00000004:00080000:2.0:1784938199.794637:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aee359180/2, rc 0, transno 4294967310 00000100:00100000:2.0:1784938199.794646:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065531776:192.168.201.158@tcp:6:osp-syn-0-0.0 00010000:00010000:1.0:1784938199.795399:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938199.795412:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.795427:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938199.795444:0:5793:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.795480:0:5793:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.795505:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.795692:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b2909e5e/0xea86628a8aec462d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6602 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.795722:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938199.795725:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938199.795726:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938199.795955:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2826300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11591:x1871643048769664:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 48055us (48320us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938199.795967:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 227 00000100:00100000:0.0:1784938199.798485:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065531904:192.168.201.158@tcp:6:osp-syn-1-0.0 00000100:00100000:1.0:1784938199.798853:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938199.798890:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065531904 00000100:00100000:1.0:1784938199.798900:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065531904 00000100:00100000:1.0:1784938199.798967:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 66 00000100:00100000:1.0:1784938199.798978:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065531904:12345-192.168.201.158@tcp:6:osp-syn-1-0.0 00002000:00080000:1.0:1784938199.799021:0:8127:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:1.0:1784938199.799056:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.799082:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 12 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.799093:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1784938199.799126:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1784938199.799132:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.799172:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 12 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.799191:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 12 pid: 6605 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938199.799205:0:8127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1871643065532032:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938199.799282:0:8127:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938199.799620:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065532160:192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00100000:1.0:1784938199.799785:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938199.799810:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065532160 00000100:00100000:1.0:1784938199.799815:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065532160 00000100:00100000:1.0:1784938199.799847:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 67 00000100:00100000:1.0:1784938199.799854:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3322:x1871643065532160:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 00002000:00010000:1.0:1784938199.800067:0:6602:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1784938199.800071:0:6602:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1784938200 00002000:00010000:1.0:1784938199.800074:0:6602:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1784938199.800076:0:6602:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1784938200 -> 1784938200 00002000:00010000:1.0:1784938199.800079:0:6602:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1784938199.800393:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+9:3322:x1871643065532160:12345-192.168.201.158@tcp:2:osp-syn-1-0.0 Request processed in 535us (605us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1784938199.800402:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 67 00000004:00080000:1.0:1784938199.801506:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aedc97480/2, rc 0, transno 4294967321 00000100:00100000:1.0:1784938199.801585:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065532160:192.168.201.158@tcp:2:osp-syn-1-0.0 00000100:00100000:2.0:1784938199.811459:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.811585:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769792 00000100:00100000:1.0:1784938199.811599:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769792 00000100:00100000:1.0:1784938199.811680:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:1.0:1784938199.811693:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2356:x1871643048769792:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1784938199.821932:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.822088:0:8127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1871643065532032:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938199.822135:0:8127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938199.826485:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048769920 00000100:00100000:0.0:1784938199.826504:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048769920 00010000:00010000:0.0:1784938199.826576:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 14 pid: 6605 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938199.826624:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:0.0:1784938199.826634:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+14:2356:x1871643048769920:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938199.826655:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938199.826662:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 14 pid: 6605 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826678:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 14 pid: 6605 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826708:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db8daaff/0xea86628a8aec43ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b6c expref: 14 pid: 6605 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826746:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938199.826751:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938199.826757:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826768:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826803:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938199.826879:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+13:2356:x1871643048769920:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 246us (4962us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.826887:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00010000:00010000:0.0:1784938199.826918:0:8127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826928:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826938:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826946:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.826964:0:8127:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938199.827613:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbc7d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3321:x1871643065531904:12345-192.168.201.158@tcp:6:osp-syn-1-0.0 Request processed in 28632us (28758us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1784938199.827624:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 66 00010000:00010000:0.0:1784938199.827654:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938199.827662:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.827671:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991c00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938199.827676:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.827686:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.827718:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.827725:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eea9d141/0xea86628a8aec4634 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.827747:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938199.827749:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938199.827751:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938199.831420:0:3321:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05aedc96a00/2, rc 0, transno 4294967322 00000100:00100000:2.0:1784938199.831457:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065531904:192.168.201.158@tcp:6:osp-syn-1-0.0 00000001:00080000:0.0:1784938199.902058:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:0.0:1784938199.902082:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:0.0:1784938199.902088:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1784938199.902377:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048769792:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 90677us (90938us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.902391:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:0.0:1784938199.906088:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.906326:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048770176 00000100:00100000:1.0:1784938199.906339:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048770176 00000100:00100000:1.0:1784938199.906458:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:1.0:1784938199.906470:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11591:x1871643048770176:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1784938199.906632:0:7211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938199.906677:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4618 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bff expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.906704:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:1.0:1784938199.906711:0:7211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1784938199.906754:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.906772:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.906783:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1784938199.907406:0:7211:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000147897c5 reply state 000000009be7ff3c transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938199.907422:0:7211:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1784938199.907823:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:11591:x1871643048770176:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1350us (1745us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1784938199.907832:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:1.0:1784938199.910923:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.911543:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048770304 00000100:00100000:2.0:1784938199.911556:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048770304 00000100:00100000:2.0:1784938199.911625:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1784938199.911636:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048770304:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784938199.911893:0:6605:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1784938199.911898:0:6605:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1784938200 -> 1784938199 00002000:00010000:2.0:1784938199.911900:0:6605:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1784938199 00002000:00010000:2.0:1784938199.911902:0:6605:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1784938200 -> 1784938199 00002000:00010000:2.0:1784938199.911905:0:6605:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1784938199.911974:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff81bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2355:x1871643048770304:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 340us (1066us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1784938199.911982:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00010000:00010000:3.0:1784938199.914605:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.914628:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.914636:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.914665:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938199.914672:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.914680:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.914701:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:3.0:1784938199.914703:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938199.914709:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.914714:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990800/0xea86628a8aec463b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938199.914837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.914949:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048770560 00000100:00100000:2.0:1784938199.914962:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048770560 00000100:00100000:2.0:1784938199.915057:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 229 00000100:00100000:2.0:1784938199.915070:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:11591:x1871643048770560:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.915168:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.915184:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.915204:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.915423:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.915451:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 20 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.915468:0:5804:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee35a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065532288:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938199.915684:0:5804:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938199.919006:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.919525:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048770688 00000100:00100000:1.0:1784938199.919536:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048770688 00010000:00010000:1.0:1784938199.919588:0:8373:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 21 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938199.919727:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:1.0:1784938199.919739:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2355:x1871643048770688:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938199.919758:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938199.919766:0:8373:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 21 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.919782:0:8373:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 21 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.919810:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:1.0:1784938199.919816:0:8373:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.919828:0:8373:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.919854:0:8373:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.919878:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938199.919949:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2355:x1871643048770688:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 212us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.919958:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00010000:00010000:2.0:1784938199.920840:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b000/0xea86628a8aec45fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf1 expref: 20 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.920868:0:5804:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee35a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5804:1871643065532288:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938199.920896:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.920909:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.920915:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.920958:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.920966:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.920988:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.920995:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.921000:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.921009:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.921023:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:2.0:1784938199.921027:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1784938199.921032:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.921038:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893a00/0xea86628a8aec4642 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.921128:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11591:x1871643048770560:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 6060us (6295us total) trans 0 rc -22/-22 00000100:00100000:2.0:1784938199.921139:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 229 00010000:00010000:2.0:1784938199.922457:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938199.924754:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.924862:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048770816 00000100:00100000:2.0:1784938199.924875:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048770816 00000100:00100000:2.0:1784938199.924980:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1784938199.924993:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2356:x1871643048770816:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1784938199.925057:0:8127:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.925113:0:8127:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.925123:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938199.925128:0:8127:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1784938199.925133:0:8127:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.925179:0:8127:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 8 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.925196:0:8127:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 8 pid: 6604 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.925245:0:8127:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee35a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1871643065532416:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938199.925348:0:8127:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938199.927967:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.928062:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048770944 00000100:00100000:3.0:1784938199.928073:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048770944 00010000:00010000:3.0:1784938199.928122:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 9 pid: 6604 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938199.928171:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1784938199.928181:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2355:x1871643048770944:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938199.928201:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938199.928267:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 9 pid: 6604 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.928284:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 9 pid: 6604 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.928341:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938199.928347:0:5791:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1784938199.928354:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.928365:0:5791:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.928393:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938199.928466:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+9:2355:x1871643048770944:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 285us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938199.928475:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00010000:00010000:2.0:1784938199.929283:0:8127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003690c833/0xea86628a8aec4626 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c0d expref: 8 pid: 6604 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.929308:0:8127:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee35a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8127:1871643065532416:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938199.929335:0:8127:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929348:0:8127:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929368:0:8127:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929404:0:8127:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929414:0:8127:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929423:0:8127:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929446:0:8127:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938199.929451:0:8127:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929461:0:8127:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929480:0:8127:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.929487:0:8127:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f22d4ec/0xea86628a8aec4649 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8127 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.929706:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048770816:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 4715us (4965us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.929717:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:0.0:1784938199.933164:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.933282:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048771200 00000100:00100000:3.0:1784938199.933296:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048771200 00000100:00100000:3.0:1784938199.933373:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:3.0:1784938199.933384:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11591:x1871643048771200:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938199.933518:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933540:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933554:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933842:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933876:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933885:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933929:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 20 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.933946:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 20 pid: 5806 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938199.933964:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065532544:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938199.934072:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac879e300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938199.937714:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.937967:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065532544:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938199.938007:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938199.938419:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048771328 00000100:00100000:1.0:1784938199.938440:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048771328 00010000:00010000:0.0:1784938199.938686:0:5790:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 21 pid: 5806 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938199.938766:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:0.0:1784938199.938779:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8907450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:2356:x1871643048771328:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938199.938799:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938199.938807:0:5790:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 21 pid: 5806 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.938820:0:5790:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 21 pid: 5806 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.938847:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991400/0xea86628a8aec460a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bf8 expref: 21 pid: 5806 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.938863:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:0.0:1784938199.938868:0:5790:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.938878:0:5790:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.938886:0:5790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.938937:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938199.939019:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8907450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:2356:x1871643048771328:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 242us (1320us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.939028:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00010000:00010000:3.0:1784938199.939623:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938199.939635:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1784938199.939872:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1784938199.940041:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1784938199.940091:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1784938199.940413:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065532672:192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:3.0:1784938199.940649:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad09f4240 going to sleep for 11 seconds 00000100:00100000:2.0:1784938199.941934:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938199.942059:0:5809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065532672 00000100:00100000:3.0:1784938199.942069:0:5809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065532672 00000100:00100000:3.0:1784938199.942262:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:3.0:1784938199.942274:0:5809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1871643065532672:12345-192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:3.0:1784938199.942393:0:5809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1871643065532672:12345-192.168.201.158@tcp:1000:mdt00_001.0 Request processed in 121us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938199.942402:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:3.0:1784938199.942933:0:5805:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1784938199.942943:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aff870380, transno 4294967315 00000004:00080000:3.0:1784938199.942991:0:5805:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1784938199.943013:0:5805:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aedc97480, transno 4294967321 00000100:00100000:3.0:1784938199.944030:0:5805:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffffa05aedc96a00 x1871643065531904/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 544/432 e 0 to 0 dl 1784938215 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938199.944050:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc97800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065532672:192.168.201.158@tcp:1000:mdt00_001.0 00000001:00080000:2.0:1784938199.944852:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1784938199.944959:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee35a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065532800:192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:2.0:1784938199.945173:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3000 going to sleep for 11 seconds 00000100:00100000:0.0:1784938199.945675:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938199.945748:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065532800 00000100:00100000:2.0:1784938199.945758:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065532800 00000100:00100000:2.0:1784938199.945821:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00100000:2.0:1784938199.945831:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5805:x1871643065532800:12345-192.168.201.158@tcp:1000:mdt00_001.0 00000100:00100000:2.0:1784938199.946249:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5805:x1871643065532800:12345-192.168.201.158@tcp:1000:mdt00_001.0 Request processed in 417us (575us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1784938199.946260:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00100000:2.0:1784938199.946571:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee35a680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5805:1871643065532800:192.168.201.158@tcp:1000:mdt00_001.0 00010000:00010000:2.0:1784938199.946625:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946637:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946647:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946654:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.946678:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946688:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946707:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8500) 00010000:00010000:2.0:1784938199.946711:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938199.946717:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946723:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec4657 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946764:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946770:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946776:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946781:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.946784:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946791:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946799:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938199.946801:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938199.946813:0:5805:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946827:0:5805:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946837:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.946873:0:5805:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 23 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.946889:0:5805:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065532928:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784938199.946947:0:5805:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3000 going to sleep for 11 seconds 00000100:00100000:2.0:1784938199.949659:0:5805:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5805:1871643065532928:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784938199.949701:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949714:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec459a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949755:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949772:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949786:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949822:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949828:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949836:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949842:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.949847:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949854:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949868:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938199.949872:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938199.949875:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949881:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec465e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949891:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949897:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949902:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949914:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938199.949917:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949923:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949931:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938199.949934:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938199.949937:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.949942:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.950258:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:11591:x1871643048771200:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 16873us (17107us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1784938199.950271:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 230 00000020:00080000:2.0:1784938199.950278:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1784938199.950570:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938199.950577:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938199.951285:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1784938199.951310:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938199.953909:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938199.954268:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048771584 00000100:00100000:0.0:1784938199.954282:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048771584 00000100:00100000:0.0:1784938199.954347:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1784938199.954357:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+23:11591:x1871643048771584:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1784938199.956351:0:5808:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1784938199.956478:0:5808:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1784938199.957197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1784938199.957818:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.957841:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.957855:0:5808:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.957865:0:5808:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.957871:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.957893:0:5808:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.957960:0:5808:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1784938199.958098:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:11591:x1871643048771584:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 3739us (4201us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1784938199.958118:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000020:00080000:0.0:1784938199.958126:0:5808:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1784938199.958159:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048771712 00000100:00100000:0.0:1784938199.958169:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048771712 00000100:00100000:0.0:1784938199.958206:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1784938199.958232:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:11590:x1871643048771712:12345-192.168.201.58@tcp:49:lfs.0 00000100:00100000:0.0:1784938199.958331:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:11590:x1871643048771712:12345-192.168.201.58@tcp:49:lfs.0 Request processed in 116us (1140us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.958337:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00010000:00010000:1.0:1784938199.959001:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938199.959013:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.959024:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938199.959029:0:5794:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.959039:0:5794:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.959058:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffffa05ac30f8b00) 00010000:00010000:1.0:1784938199.959061:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1784938199.959067:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938199.959073:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031800/0xea86628a8aec4665 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5808 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938199.959348:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938199.959351:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938199.959353:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938199.962337:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.962488:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048771968 00000100:00100000:2.0:1784938199.962502:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048771968 00000100:00100000:2.0:1784938199.962792:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 231 00000100:00100000:2.0:1784938199.962802:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:11590:x1871643048771968:12345-192.168.201.58@tcp:58:lfs.0 00000040:00080000:2.0:1784938199.963127:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1784938199.963269:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:11590:x1871643048771968:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 468us (944us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.963276:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 231 00000100:00100000:3.0:1784938199.988342:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.988465:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938199.988508:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938199.988637:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772352 00000100:00100000:1.0:1784938199.988651:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772352 00000100:00100000:1.0:1784938199.988763:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:1.0:1784938199.988775:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048772352:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938199.988878:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2358:x1871643048772352:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 105us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938199.988887:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:0.0:1784938199.989045:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772224 00000100:00100000:0.0:1784938199.989050:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772224 00000100:00100000:0.0:1784938199.989098:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:0.0:1784938199.989105:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2358:x1871643048772224:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938199.989138:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2358:x1871643048772224:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938199.989143:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00080000:3.0:1784938199.989578:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938199.993275:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772096 00000100:00100000:2.0:1784938199.993321:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772096 00000100:00100000:2.0:1784938199.993407:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 298 00000100:00100000:2.0:1784938199.993420:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048772096:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938199.993553:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2358:x1871643048772096:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 136us (5226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938199.993561:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 298 00000100:00100000:3.0:1784938199.995435:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938199.995810:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772480 00000100:00100000:2.0:1784938199.995824:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772480 00000100:00100000:2.0:1784938199.995900:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:2.0:1784938199.995912:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+25:11593:x1871643048772480:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938199.995945:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938199.995982:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec466c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c14 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996078:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996097:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996110:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996127:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996134:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996141:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996563:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996577:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996587:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996651:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938199.996668:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 26 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938199.996686:0:5806:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065533056:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938199.996792:0:5806:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac2fb3000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938200.003626:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938200.003896:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772736 00000100:00100000:0.0:1784938200.003930:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772736 00000100:00100000:0.0:1784938200.004015:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:0.0:1784938200.004028:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:5570:x1871643048772736:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1784938200.004379:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:5570:x1871643048772736:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 351us (778us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1784938200.004389:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1784938200.006820:0:5806:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5806:1871643065533056:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938200.006861:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938200.007791:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938200.007906:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772864 00000100:00100000:0.0:1784938200.007916:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772864 00010000:00010000:0.0:1784938200.007973:0:5791:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 28 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938200.008028:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784938200.008040:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:2356:x1871643048772864:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938200.008063:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938200.008072:0:5791:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 28 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938200.008083:0:5791:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 28 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938200.008117:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec458c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bd5 expref: 28 pid: 5804 timeout: 508 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938200.008132:0:5791:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:0.0:1784938200.008138:0:5791:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938200.008165:0:5791:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938200.008172:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938200.008199:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938200.008373:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008393:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938200.008460:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1784938200.008466:0:5806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938200.008492:0:5806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008702:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008718:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008725:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008732:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008738:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938200.008743:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008753:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008763:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:3.0:1784938200.008765:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938200.008769:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008781:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4673 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008791:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008795:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008799:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008802:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938200.008804:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008807:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008811:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffffa05ad886bd00) 00010000:00010000:3.0:1784938200.008813:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938200.008814:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008817:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec467a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008853:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec466c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c14 expref: 28 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008863:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c14 expref: 27 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938200.008872:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:3.0:1784938200.008874:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1784938200.008876:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:3.0:1784938200.009009:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+27:11593:x1871643048772480:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 13099us (13594us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938200.009018:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:0.0:1784938200.009115:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:2356:x1871643048772864:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1078us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938200.009122:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784938200.117396:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065533184:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938200.117832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938200.117951:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065533184 00000100:00100000:1.0:1784938200.117963:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065533184 00000100:00100000:1.0:1784938200.118034:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 73 00000100:00100000:1.0:1784938200.118045:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065533184:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938200.118078:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1784938200.118143:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065533184:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 99us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938200.118150:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 73 00000100:00100000:0.0:1784938200.120925:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee35bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065533184:192.168.201.158@tcp:13:osp-pre-1-0.0 00000040:00080000:2.0:1784938200.808855:0:12477:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1784938200.808866:0:12477:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1784938200.808925:0:12477:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1784938200.808931:0:12477:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784938200.963737:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938201.009773:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1784938201.009783:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1784938201.009820:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1784938201.009913:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1784938201.010053:0:11553:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff971500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065533312:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1784938201.010158:0:11553:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad843ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938201.015801:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938201.016515:0:11553:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff971500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11553:1871643065533312:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1784938201.021765:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048772992 00000100:00100000:2.0:1784938201.021779:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048772992 00000100:00100000:2.0:1784938201.021847:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 233 00000100:00100000:2.0:1784938201.021858:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11606:x1871643048772992:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1784938201.021896:0:7211:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1784938201.022018:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11606:x1871643048772992:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 161us (6226us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938201.022026:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 233 00000100:00080000:3.0:1784938201.022843:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938201.038135:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938201.046098:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048773248 00000100:00100000:0.0:1784938201.046116:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048773248 00000100:00100000:2.0:1784938201.055045:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:2.0:1784938201.055065:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+26:11606:x1871643048773248:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1784938201.055089:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938201.055110:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4688 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c1b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.055211:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec468f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.055350:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.055363:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec468f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938201.055377:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1784938201.055539:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892a00/0xea86628a8aec4688 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c1b expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.055558:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec468f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c1b expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.055575:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938201.055579:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938201.055582:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938201.055771:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:11606:x1871643048773248:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 711us (17645us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1784938201.055780:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:3.0:1784938201.064366:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938201.064717:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048773504 00000100:00100000:0.0:1784938201.064728:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048773504 00000100:00100000:0.0:1784938201.064793:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 235 00000100:00100000:0.0:1784938201.064804:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:11606:x1871643048773504:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1784938201.064884:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938201.064914:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938201.064928:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067471:0:7211:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067488:0:7211:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067496:0:7211:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067502:0:7211:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938201.067507:0:7211:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067515:0:7211:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067532:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:2.0:1784938201.067535:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938201.067540:0:7211:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938201.067547:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac0031400/0xea86628a8aec469d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938201.067957:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938201.068885:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:11606:x1871643048773504:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 4078us (4524us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1784938201.068899:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 235 00000100:00100000:0.0:1784938201.069341:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048773632 00000100:00100000:0.0:1784938201.069351:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048773632 00000100:00100000:0.0:1784938201.069427:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784938201.069438:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:2355:x1871643048773632:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938201.069454:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938201.069476:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec468f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c1b expref: 29 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938201.069493:0:8373:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:0.0:1784938201.069498:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938201.069531:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:2355:x1871643048773632:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 97us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938201.069538:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000040:00080000:1.0:1784938201.072478:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938201.072557:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938201.076707:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1784938201.076728:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938201.082858:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938201.082915:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048773888 00000100:00100000:3.0:1784938201.082924:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048773888 00000100:00100000:3.0:1784938201.082977:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1784938201.082986:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+28:11606:x1871643048773888:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784938201.083275:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:11606:x1871643048773888:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 289us (426us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1784938201.083285:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000001:00080000:1.0:1784938201.701295:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1784938201.701315:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1784938201.970347:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938202.673473:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065533440:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938202.673948:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938202.674091:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065533440 00000100:00100000:1.0:1784938202.674099:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065533440 00000100:00100000:1.0:1784938202.674197:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00080000:0.0:1784938202.674198:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938202.674207:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065533440:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938202.674274:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938202.674345:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065533440:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 139us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938202.674354:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00100000:1.0:1784938202.678654:0:3324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1784938202.678669:0:3324:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1784938202.678816:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aee359180, transno 4294967310 00000100:00100000:1.0:1784938202.678845:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065533440:192.168.201.158@tcp:13:osp-pre-0-0.0 00000040:00080000:1.0:1784938202.768909:0:12529:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938202.768919:0:12529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938202.768967:0:12529:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1784938202.768972:0:12529:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1784938202.993621:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938203.105597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938203.105680:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774144 00000100:00100000:3.0:1784938203.105691:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774144 00000100:00100000:3.0:1784938203.105763:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00100000:3.0:1784938203.105774:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+29:11626:x1871643048774144:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1784938203.105814:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938203.105838:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c22 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.105977:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec46ab lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.105994:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec46ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.106010:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec46ab lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938203.106022:0:5806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1784938203.106166:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c22 expref: 32 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.106187:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec46ab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c22 expref: 31 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.106196:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:3.0:1784938203.106199:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1784938203.106204:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c000, rc 0) 00000100:00100000:3.0:1784938203.106302:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:11626:x1871643048774144:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 529us (715us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1784938203.106310:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00080000:0.0:1784938203.106709:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938203.112105:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938203.112166:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774272 00000100:00100000:3.0:1784938203.112174:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774272 00000100:00100000:3.0:1784938203.112243:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:3.0:1784938203.112250:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:11626:x1871643048774272:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1784938203.112321:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112353:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112362:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112400:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112411:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112418:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112425:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938203.112429:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112437:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112448:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:3.0:1784938203.112452:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1784938203.112457:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938203.112464:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938203.112541:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c2825c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:11626:x1871643048774272:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 289us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938203.112555:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:3.0:1784938203.199545:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938203.200111:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774400 00000100:00100000:1.0:1784938203.200123:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774400 00000100:00080000:0.0:1784938203.200312:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938203.200396:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1784938203.200410:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2357:x1871643048774400:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:1.0:1784938203.200429:0:6604:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938203.200451:0:6604:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000075a3fab/0xea86628a8aec46c0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c29 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938203.200481:0:6604:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a63fed7, atime: 0x6a63fed7, ctime: 0x6a63fed7, blocks: 0xb 00010000:00010000:1.0:1784938203.200502:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=412s v=(0 0) 00010000:00010000:1.0:1784938203.200507:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938203.200518:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000075a3fab/0xea86628a8aec46c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c29 expref: 8 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938203.200560:0:6604:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000075a3fab/0xea86628a8aec46c0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c29 expref: 8 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938203.200575:0:6604:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990000, rc 0) 00000100:00100000:1.0:1784938203.200655:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2357:x1871643048774400:12345-192.168.201.58@tcp:101:cat.0 Request processed in 248us (1122us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938203.200662:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:0.0:1784938203.203940:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938203.204029:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774528 00000100:00100000:3.0:1784938203.204038:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774528 00002000:00100000:3.0:1784938203.204095:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa05aee076300 x1871643048774528/t0(0) o3->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:434/0 lens 488/0 e 0 to 0 dl 1784938214 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938203.204107:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aee076300 with x1871643048774528 ext(0->4095) 00002000:00010000:3.0:1784938203.204112:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aee076300 00000100:00100000:3.0:1784938203.204141:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1784938203.204149:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2358:x1871643048774528:12345-192.168.201.58@tcp:3:cat.0 00000100:00100000:3.0:1784938203.204391:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2358:x1871643048774528:12345-192.168.201.58@tcp:3:cat.0 Request processed in 241us (459us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1784938203.204399:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00002000:00100000:3.0:1784938203.204405:0:6610:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffffa05aee076300 x1871643048774528/t0(0) o3->8bbc0047-63c1-4cac-b5e6-ede401808e2e@192.168.201.58@tcp:434/0 lens 488/4536 e 0 to 0 dl 1784938214 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1784938203.204414:0:6610:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffffa05aee076300 with x1871643048774528 ext(0->4095) 00002000:00010000:3.0:1784938203.204417:0:6610:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffffa05aee076300 00010000:00010000:0.0:1784938204.020891:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938204.145526:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1784938204.145537:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1784938204.145591:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1784938204.145600:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1784938204.722661:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065533568:0@lo:400:kworker.0 00000100:00100000:2.0:1784938204.722734:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938204.722800:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065534080:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.722879:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938204.722886:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065533696:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.722925:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065534208:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.722961:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065533824:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.722985:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938204.722991:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac8229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065533952:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.723168:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938204.723243:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938204.723264:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938204.723284:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938204.723305:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938204.723331:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534208 00000100:00100000:2.0:1784938204.723337:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534208 00000100:00100000:3.0:1784938204.723371:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065533696 00000100:00100000:3.0:1784938204.723376:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065533696 00000100:00100000:2.0:1784938204.723403:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065533952 00000100:00100000:2.0:1784938204.723406:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065533952 00000100:00100000:3.0:1784938204.723413:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065533824 00000100:00100000:3.0:1784938204.723416:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065533824 00000100:00100000:2.0:1784938204.723429:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 96 00000100:00100000:3.0:1784938204.723437:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534080 00000100:00100000:2.0:1784938204.723437:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065534208:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938204.723439:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534080 00000100:00100000:3.0:1784938204.723453:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 167 00000100:00100000:3.0:1784938204.723458:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065533696:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938204.723543:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 168 00000100:00100000:1.0:1784938204.723554:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065533824:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.723601:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065534208:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 164us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938204.723609:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 96 00000100:00100000:2.0:1784938204.723629:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 97 00000100:00100000:2.0:1784938204.723635:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065533952:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938204.723695:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065533568 00000100:00100000:0.0:1784938204.723699:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065533568 00000100:00100000:0.0:1784938204.723727:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1784938204.723734:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065533568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938204.724440:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065533696:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 978us (1269us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938204.724449:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 167 00000100:00100000:3.0:1784938204.724469:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 169 00000100:00100000:3.0:1784938204.724477:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065534080:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938204.724509:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee358a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065534080:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 34us (1245us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938204.724516:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 169 00000100:00100000:1.0:1784938204.725173:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065533824:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 1618us (1925us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938204.725182:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 168 00000100:00080000:3.0:1784938204.726953:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1784938204.726965:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938204.726968:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1784938204.734501:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee358700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065533952:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 10850us (11179us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938204.734519:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 97 00000100:00100000:2.0:1784938204.734911:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065533952:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.734925:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065533824:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.734966:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065533696:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.734980:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac8229500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065534208:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938204.734991:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065534080:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938204.735584:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065533568:12345-0@lo:400:kworker.0 Request processed in 11847us (12847us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938204.735595:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1784938204.743639:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065533568:0@lo:400:kworker.0 00010000:00010000:2.0:1784938205.041737:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938205.124472:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938205.124517:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938205.124565:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938205.124590:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938205.124611:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938205.124642:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775168 00000100:00100000:3.0:1784938205.124652:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775168 00000100:00100000:3.0:1784938205.124715:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774784 00000100:00100000:3.0:1784938205.124718:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774784 00000100:00100000:3.0:1784938205.124743:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 170 00000100:00100000:3.0:1784938205.124752:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048775168:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938205.124833:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee236680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2356:x1871643048775168:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 82us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938205.124858:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 170 00000100:00100000:3.0:1784938205.124884:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:3.0:1784938205.124890:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:2356:x1871643048774784:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938205.124925:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee234000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+31:2356:x1871643048774784:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 35us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938205.124931:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:2.0:1784938205.124934:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774912 00000100:00100000:2.0:1784938205.124938:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774912 00000100:00100000:3.0:1784938205.124953:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775040 00000100:00100000:3.0:1784938205.124956:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775040 00000100:00100000:2.0:1784938205.124970:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:3.0:1784938205.124977:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:2.0:1784938205.124977:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac868c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048774912:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938205.124982:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2356:x1871643048775040:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938205.125005:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+8:2356:x1871643048775040:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938205.125005:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac868c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048774912:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938205.125012:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:2.0:1784938205.125021:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00080000:3.0:1784938205.125027:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938205.125031:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938205.125034:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938205.125449:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048774656 00000100:00100000:0.0:1784938205.125454:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048774656 00000100:00100000:0.0:1784938205.125496:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 300 00000100:00100000:0.0:1784938205.125504:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048774656:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938205.125545:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048774656:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 41us (1085us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938205.125551:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 300 00000100:00100000:2.0:1784938205.233474:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065534336:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938205.233733:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938205.233760:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534336 00000100:00100000:2.0:1784938205.233768:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534336 00000100:00100000:3.0:1784938205.233971:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 75 00000100:00100000:3.0:1784938205.233983:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065534336:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938205.234019:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938205.234062:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065534336:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 82us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938205.234070:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 75 00000100:00100000:3.0:1784938205.234247:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee358380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065534336:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:00080000:1.0:1784938205.317545:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000020:00080000:1.0:1784938205.317570:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1784938205.317595:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967517 is committed 00000020:00080000:1.0:1784938205.317610:0:5828:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffffa05ac2fb3b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1784938205.317615:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05afc8b3800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffffa05ac2fb36c0 00000020:00080000:1.0:1784938205.317619:0:5828:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffffa05afc8b3f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffffa05aff8de000 00000001:00080000:1.0:1784938205.317627:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1784938205.317788:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1784938205.317993:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:0.0:1784938205.342292:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1784938205.342313:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1784938205.342320:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00010000:00010000:0.0:1784938206.065779:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938207.091631:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938207.796860:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065534464:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938207.799768:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938207.800109:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534464 00000100:00100000:1.0:1784938207.800118:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534464 00000100:00100000:1.0:1784938207.800181:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 76 00000100:00100000:1.0:1784938207.800191:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065534464:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938207.800269:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938207.800404:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee358380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065534464:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 214us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938207.800412:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 76 00000100:00100000:1.0:1784938207.800593:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee359880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065534464:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:3.0:1784938207.800684:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1784938208.115326:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938208.389205:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938208.389363:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775296 00000100:00100000:3.0:1784938208.389375:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775296 00000100:00100000:3.0:1784938208.389454:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00100000:3.0:1784938208.389467:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11271:x1871643048775296:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1784938208.389592:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff818a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11271:x1871643048775296:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 Request processed in 127us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938208.389600:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00080000:0.0:1784938208.390137:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938208.397291:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938208.397399:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775552 00000100:00100000:1.0:1784938208.397410:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775552 00000100:00100000:1.0:1784938208.397472:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:1.0:1784938208.397483:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:11271:x1871643048775552:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1784938208.399410:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:11271:x1871643048775552:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1916us (2130us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1784938208.399426:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:2.0:1784938208.753572:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938208.753679:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775680 00000100:00100000:3.0:1784938208.753696:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775680 00000100:00100000:3.0:1784938208.753801:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00100000:3.0:1784938208.753814:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:12078:x1871643048775680:12345-192.168.201.58@tcp:101:lsof.0 00010000:00010000:3.0:1784938208.753843:0:7211:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938208.753872:0:7211:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46c7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c30 expref: -99 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938208.753961:0:7211:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46ce lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938208.753980:0:7211:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938208.753994:0:7211:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938208.754333:0:7211:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1784938208.754338:0:7211:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938208.754431:0:7211:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46ce lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7211 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938208.754469:0:7211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d400/0xea86628a8aec46c7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c30 expref: 7 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938208.754489:0:7211:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46ce lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c30 expref: 6 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938208.754501:0:7211:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:3.0:1784938208.754504:0:7211:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938208.754509:0:7211:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c200, rc 0) 00000100:00100000:3.0:1784938208.754600:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:12078:x1871643048775680:12345-192.168.201.58@tcp:101:lsof.0 Request processed in 788us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938208.754609:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00080000:0.0:1784938208.754845:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1784938209.137623:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938209.842133:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065534720:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938209.842313:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065535232:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938209.842379:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784938209.842387:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065534592:0@lo:400:kworker.0 00000100:00100000:1.0:1784938209.842438:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938209.842468:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065535104:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938209.842507:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065534976:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938209.842534:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938209.842540:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065534848:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938209.843025:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938209.843089:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938209.843112:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938209.843128:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938209.843141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938209.843160:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534720 00000100:00100000:1.0:1784938209.843168:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534720 00000100:00100000:1.0:1784938209.843202:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535104 00000100:00100000:1.0:1784938209.843204:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535104 00000100:00100000:1.0:1784938209.843244:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534848 00000100:00100000:1.0:1784938209.843247:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534848 00000100:00100000:1.0:1784938209.843278:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 172 00000100:00100000:1.0:1784938209.843287:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065534720:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938209.843441:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534592 00000100:00100000:0.0:1784938209.843445:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534592 00000100:00100000:0.0:1784938209.843479:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1784938209.843486:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065534592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938209.843544:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065534592:12345-0@lo:400:kworker.0 Request processed in 59us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938209.843552:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1784938209.843559:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535232 00000100:00100000:3.0:1784938209.843565:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535232 00000100:00100000:3.0:1784938209.843606:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065534976 00000100:00080000:0.0:1784938209.843607:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938209.843610:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065534976 00000100:00080000:0.0:1784938209.843613:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938209.843648:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 100 00000100:00100000:0.0:1784938209.843648:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065534592:0@lo:400:kworker.0 00000100:00100000:3.0:1784938209.843661:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065535232:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938209.843705:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb420380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065535232:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 48us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938209.843712:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 100 00000100:00100000:3.0:1784938209.843726:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 101 00000100:00100000:3.0:1784938209.843732:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065534976:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938209.843756:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065534976:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (668us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938209.843772:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 101 00000100:00080000:3.0:1784938209.843811:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938209.843822:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 173 00000100:00100000:0.0:1784938209.843965:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065535104:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938209.843993:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff835180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065535104:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938209.844185:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065534976:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938209.844210:0:7211:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1784938209.844234:0:7211:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00100000:1.0:1784938209.844485:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065534720:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 1196us (1369us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938209.852596:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 174 00000100:00100000:3.0:1784938209.852629:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065534848:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938209.852788:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 173 00000100:00100000:0.0:1784938209.853070:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065535104:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938209.853085:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065534720:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938209.853096:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:0.0:1784938209.853102:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05aedc96a00, transno 4294967322 00000004:00080000:0.0:1784938209.853118:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:0.0:1784938209.853138:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065535232:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938209.854445:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065534848:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 1823us (11289us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938209.854459:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 174 00000100:00100000:3.0:1784938209.856068:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065534848:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938209.857363:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 172 00010000:00010000:0.0:1784938210.161557:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938210.234680:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938210.234728:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938210.234774:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938210.234798:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938210.234826:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938210.234862:0:12695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775936 00000100:00100000:0.0:1784938210.234887:0:12695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775936 00000100:00100000:0.0:1784938210.234950:0:12695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776320 00000100:00100000:0.0:1784938210.234953:0:12695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776320 00000100:00100000:0.0:1784938210.234975:0:12695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:0.0:1784938210.234985:0:12695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:2356:x1871643048775936:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938210.235072:0:12695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:2356:x1871643048775936:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 87us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938210.235079:0:12695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:2.0:1784938210.235469:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048775808 00000100:00100000:2.0:1784938210.235475:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048775808 00000100:00100000:2.0:1784938210.235510:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 302 00000100:00100000:2.0:1784938210.235518:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048775808:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938210.235549:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87de450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2356:x1871643048775808:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (783us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938210.235556:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 302 00000100:00100000:2.0:1784938210.235592:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:2.0:1784938210.235600:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2356:x1871643048776320:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938210.235625:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2356:x1871643048776320:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938210.235631:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:3.0:1784938210.236494:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776192 00000100:00100000:3.0:1784938210.236505:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776192 00000100:00100000:3.0:1784938210.236550:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776064 00000100:00100000:3.0:1784938210.236553:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776064 00000100:00100000:3.0:1784938210.236622:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:3.0:1784938210.236630:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048776192:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938210.236685:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2356:x1871643048776192:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 56us (1956us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938210.236691:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:3.0:1784938210.236705:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:3.0:1784938210.236711:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048776064:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938210.236736:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2356:x1871643048776064:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (1937us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938210.236743:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00080000:3.0:1784938210.236761:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938210.236765:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938210.236793:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938210.363788:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938210.363825:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065535360:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938210.364138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938210.364167:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535360 00000100:00100000:1.0:1784938210.364173:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535360 00000100:00100000:1.0:1784938210.364257:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 77 00000100:00100000:1.0:1784938210.364267:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065535360:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938210.364306:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938210.364357:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065535360:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938210.364385:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 77 00000100:00100000:1.0:1784938210.364545:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff9bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065535360:192.168.201.158@tcp:13:osp-pre-1-0.0 00000020:00080000:0.0:1784938210.437648:0:5828:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1784938210.437696:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1784938210.437710:0:5839:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:0.0:1784938210.437962:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00010000:00010000:2.0:1784938211.185470:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938212.181510:0:12734:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 20:10:11 (1784938211) 00010000:00010000:1.0:1784938212.218031:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938212.914623:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065535488:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938212.915081:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938212.915113:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535488 00000100:00100000:3.0:1784938212.915120:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535488 00000100:00100000:3.0:1784938212.915177:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 78 00000100:00100000:3.0:1784938212.915188:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065535488:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938212.915308:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938212.915356:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af52bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065535488:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 168us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938212.915364:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 78 00000100:00080000:3.0:1784938212.915388:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938212.915527:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065535488:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:2.0:1784938213.233672:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938214.257391:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938214.385543:0:11553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1784938214.385566:0:11553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938214.388549:0:11553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1784938214.388578:0:11553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1784938214.963208:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af5378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065535872:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938214.963353:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065535744:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938214.963447:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065536256:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938214.963496:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1784938214.963503:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065535616:0@lo:400:kworker.0 00000100:00100000:1.0:1784938214.963550:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938214.963581:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065536128:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938214.965238:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938214.966029:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938214.966047:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065536000:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938214.966478:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938214.966531:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938214.966592:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535744 00000100:00100000:2.0:1784938214.966600:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535744 00000100:00100000:2.0:1784938214.966658:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536128 00000100:00100000:2.0:1784938214.966662:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536128 00000100:00100000:2.0:1784938214.969782:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 177 00000100:00100000:2.0:1784938214.969810:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065535744:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938214.969920:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1871643065535744:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 122us (3444us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938214.969929:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 177 00000100:00100000:2.0:1784938214.969961:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 178 00000100:00100000:2.0:1784938214.969970:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065536128:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938214.970000:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1871643065536128:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 32us (3469us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938214.970007:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 178 00000100:00080000:2.0:1784938214.972392:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938214.978428:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065536128:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938214.978459:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3322:1871643065535744:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938214.978541:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938214.978589:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938214.978630:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535872 00000100:00100000:3.0:1784938214.978638:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535872 00000100:00100000:3.0:1784938214.978719:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 179 00000100:00100000:3.0:1784938214.978729:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065535872:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938214.978800:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065535872:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938214.978808:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 179 00000100:00080000:3.0:1784938214.978830:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938214.983792:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536256 00000100:00100000:0.0:1784938214.983809:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536256 00000100:00100000:0.0:1784938214.984045:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 104 00000100:00100000:0.0:1784938214.984058:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065536256:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938214.984151:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065536256:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 95us (18943us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938214.984159:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 104 00000100:00100000:0.0:1784938214.984205:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065535616 00000100:00100000:0.0:1784938214.984210:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065535616 00000100:00100000:0.0:1784938214.984329:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1784938214.984337:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065535616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938214.984410:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3322:x1871643065535616:12345-0@lo:400:kworker.0 Request processed in 74us (20859us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938214.984418:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00080000:3.0:1784938214.984684:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938214.987200:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac83e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3322:1871643065535616:0@lo:400:kworker.0 00000100:00100000:0.0:1784938214.987249:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065536256:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938214.988517:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536000 00000100:00100000:3.0:1784938214.988528:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536000 00000100:00100000:3.0:1784938214.988612:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 105 00000100:00100000:3.0:1784938214.988623:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065536000:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938214.988708:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af525b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065536000:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 87us (10118us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938214.988716:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 105 00000100:00080000:1.0:1784938214.989491:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938214.990124:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065536000:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938214.990142:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af5378a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065535872:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938215.281388:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938215.348625:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938215.348672:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938215.348737:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938215.348823:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776832 00000100:00100000:0.0:1784938215.348833:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776832 00000100:00100000:1.0:1784938215.348834:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938215.348869:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00080000:1.0:1784938215.348893:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938215.348913:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776704 00000100:00100000:0.0:1784938215.348918:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776704 00000100:00100000:1.0:1784938215.348936:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:1.0:1784938215.348950:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048776832:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938215.348958:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:0.0:1784938215.348970:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae1689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048776704:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1784938215.349057:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776576 00000100:00100000:2.0:1784938215.349062:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776576 00000100:00100000:2.0:1784938215.349096:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776960 00000100:00100000:2.0:1784938215.349099:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776960 00000100:00100000:2.0:1784938215.349121:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:2.0:1784938215.349129:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ae168ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:2355:x1871643048776576:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938215.349205:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2355:x1871643048776832:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 258us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938215.349259:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:1.0:1784938215.349287:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:1.0:1784938215.349296:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2355:x1871643048776960:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938215.354174:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048776448 00000100:00100000:3.0:1784938215.354192:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048776448 00000100:00100000:3.0:1784938215.354297:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 304 00000100:00100000:3.0:1784938215.354308:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048776448:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938215.357781:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae1689180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2355:x1871643048776704:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 8798us (8932us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938215.357801:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00080000:0.0:1784938215.357867:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938215.357874:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938215.357914:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ae168ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:2355:x1871643048776576:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 8782us (9297us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938215.357939:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:1.0:1784938215.361052:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2355:x1871643048776960:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 11743us (12167us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938215.361068:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:3.0:1784938215.368012:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2355:x1871643048776448:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 13693us (19261us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938215.368028:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 304 00000100:00100000:1.0:1784938215.473774:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065536384:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:0.0:1784938215.474239:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938215.474825:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536384 00000100:00100000:3.0:1784938215.474836:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536384 00000100:00100000:3.0:1784938215.474907:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 79 00000100:00100000:3.0:1784938215.474918:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065536384:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938215.475062:0:6606:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938215.475124:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065536384:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 207us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938215.475133:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 79 00000100:00100000:0.0:1784938215.477520:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065536384:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:0.0:1784938216.307133:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938217.331113:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938217.761841:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938217.761964:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048777216 00000100:00100000:2.0:1784938217.761978:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048777216 00000100:00100000:2.0:1784938217.762274:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1784938217.762290:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+18:12300:x1871643048777216:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:2.0:1784938217.764506:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:12300:x1871643048777216:12345-192.168.201.58@tcp:35:umount.0 Request processed in 2208us (2666us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1784938217.764521:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00080000:0.0:1784938217.766810:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938217.775544:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938217.778339:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048777472 00000100:00100000:3.0:1784938217.778355:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048777472 00000100:00100000:3.0:1784938217.778427:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:3.0:1784938217.778437:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+19:12300:x1871643048777472:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:3.0:1784938217.778829:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:12300:x1871643048777472:12345-192.168.201.58@tcp:35:umount.0 Request processed in 392us (3296us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1784938217.778838:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:1.0:1784938217.784292:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938217.784396:0:5808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048777728 00000100:00100000:3.0:1784938217.784406:0:5808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048777728 00000100:00100000:3.0:1784938217.784528:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:3.0:1784938217.784540:0:5808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ad193f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+20:12300:x1871643048777728:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:3.0:1784938217.785009:0:5808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ad193f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:12300:x1871643048777728:12345-192.168.201.58@tcp:35:umount.0 Request processed in 470us (725us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1784938217.785019:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:1.0:1784938217.792445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938217.792575:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048777984 00000100:00100000:2.0:1784938217.792585:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048777984 00000100:00100000:2.0:1784938217.792636:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1784938217.792646:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+21:12300:x1871643048777984:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:2.0:1784938217.792969:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:12300:x1871643048777984:12345-192.168.201.58@tcp:35:umount.0 Request processed in 323us (541us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1784938217.792977:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1784938217.804962:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938217.805008:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938217.805038:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938217.805071:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938217.805145:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048778496 00000100:00100000:0.0:1784938217.805159:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048778496 00000100:00100000:1.0:1784938217.805197:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048778368 00000100:00100000:1.0:1784938217.805202:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048778368 00000100:00100000:0.0:1784938217.805246:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048778624 00000100:00100000:0.0:1784938217.805249:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048778624 00000100:00100000:0.0:1784938217.805262:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048778752 00000100:00100000:0.0:1784938217.805264:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048778752 00000100:00100000:1.0:1784938217.805278:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:0.0:1784938217.805278:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938217.805287:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2354:x1871643048778368:12345-192.168.201.58@tcp:9:umount.0 00000100:00100000:0.0:1784938217.805287:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+15:2357:x1871643048778496:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938217.805315:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000020:00000080:1.0:1784938217.805320:0:6604:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3c86 00000020:00010000:1.0:1784938217.805326:0:6604:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa05ad09b7000: total 0 00000100:00080000:1.0:1784938217.805331:0:6604:0:(import.c:65:import_set_state_nolock()) ffffa05ad09b6000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1784938217.805333:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893200/0xea86628a8aec36e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977bb expref: 15 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938217.805350:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000001:00000004:1.0:1784938217.805376:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1784938217.805413:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+14:2357:x1871643048778496:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 127us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938217.805420:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784938217.805448:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1784938217.805453:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+13:2357:x1871643048778624:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938217.805461:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938217.805469:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030600/0xea86628a8aec36ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897783 expref: 13 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938217.805477:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938217.805493:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+12:2357:x1871643048778624:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938217.805499:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1784938217.805509:0:5791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:0.0:1784938217.805515:0:5791:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2356:x1871643048778752:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938217.805522:0:5791:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938217.805530:0:5791:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8990600/0xea86628a8aec395a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897886 expref: 11 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938217.805538:0:5791:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938217.805552:0:5791:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2356:x1871643048778752:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 37us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938217.805563:0:5791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000020:00010000:0.0:1784938217.805599:0:5794:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa05ad09b7000: total 0 00010000:00010000:0.0:1784938217.805625:0:5794:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa05ad09b7000, canceled 0 locks, left on hash table 2. 00000100:00100000:1.0:1784938217.805644:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2354:x1871643048778368:12345-192.168.201.58@tcp:9:umount.0 Request processed in 358us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938217.805650:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00010000:00010000:0.0:1784938217.805668:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000075a3fab/0xea86628a8aec46c0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c29 expref: 4 pid: 6604 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938217.805696:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e8d7786/0xea86628a8aec4022 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a5b expref: 3 pid: 8127 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938217.805711:0:5794:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa05ad09b7000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1784938217.805722:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938217.805724:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938217.805726:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938217.805734:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938217.812139:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938217.812325:0:6605:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048778880 00000100:00100000:0.0:1784938217.812336:0:6605:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048778880 00000100:00080000:2.0:1784938217.812609:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938217.813198:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:0.0:1784938217.813256:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+5:2354:x1871643048778880:12345-192.168.201.58@tcp:9:umount.0 00000020:00000080:0.0:1784938217.813290:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3a1e 00000100:00080000:0.0:1784938217.813300:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05ae7d12000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938217.813347:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1784938217.813757:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee13fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8bbc0047-63c1-4cac-b5e6-ede401808e2e+2:2354:x1871643048778880:12345-192.168.201.58@tcp:9:umount.0 Request processed in 548us (1636us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938217.813766:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00010000:00010000:1.0:1784938217.813832:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938217.828629:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938217.829916:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048779904 00000100:00100000:3.0:1784938217.829931:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048779904 00000100:00100000:3.0:1784938217.830003:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:3.0:1784938217.830014:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+22:2354:x1871643048779904:12345-192.168.201.58@tcp:39:umount.0 00000020:00000080:3.0:1784938217.830051:0:5805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec36ba 00000020:00010000:3.0:1784938217.830070:0:5805:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa05af52ac000: total 0 00000100:00080000:3.0:1784938217.830075:0:5805:0:(import.c:65:import_set_state_nolock()) ffffa05aee04e000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1784938217.830109:0:5805:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:1.0:1784938217.830295:0:5794:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa05af52ac000: total 0 00010000:00010000:1.0:1784938217.830300:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938217.830347:0:5794:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa05af52ac000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1784938217.830409:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938217.830413:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938217.830422:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4084 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a77 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836724:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac3861200) 00010000:00010000:1.0:1784938217.836734:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938217.836744:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec39a0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89789b expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836775:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938217.836778:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784938217.836782:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec400d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a54 expref: 19 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836836:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938217.836839:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938217.836844:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4681 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c14 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836880:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938217.836883:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1784938217.836887:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c000/0xea86628a8aec46ab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c22 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836899:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938217.836901:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1784938217.836905:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87da00/0xea86628a8aec3fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a46 expref: 16 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836916:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938217.836918:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784938217.836922:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec3ce1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897982 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836933:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa05ad886b000) 00010000:00010000:1.0:1784938217.836935:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938217.836938:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec3984 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897894 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836954:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:1.0:1784938217.836957:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784938217.836961:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05acb11b400/0xea86628a8aec40a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a7e expref: 13 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836971:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffffa05ac30f8a00) 00010000:00010000:1.0:1784938217.836973:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1784938217.836982:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec437f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897b50 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.836996:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffffa05ac30f8f00) 00010000:00010000:1.0:1784938217.836998:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938217.837002:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d000/0xea86628a8aec3f03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897a0e expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.837014:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffffa05ac3861d00) 00010000:00010000:1.0:1784938217.837016:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1784938217.837019:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec39f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8978b0 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.837031:0:5794:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffffa05ac7d1d100) 00010000:00010000:1.0:1784938217.837033:0:5794:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1784938217.837036:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893400/0xea86628a8aec45a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897bdc expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938217.837048:0:5794:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa05af52ac000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1784938217.837083:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938217.837085:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938217.837088:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938217.839250:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8bbc0047-63c1-4cac-b5e6-ede401808e2e+7:2354:x1871643048779904:12345-192.168.201.58@tcp:39:umount.0 Request processed in 9228us (10621us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1784938217.839265:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:0.0:1784938218.033752:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1784938218.033780:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065536512:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938218.034183:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938218.034376:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536512 00000100:00100000:0.0:1784938218.034385:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536512 00000100:00100000:0.0:1784938218.034463:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 80 00000100:00100000:0.0:1784938218.034474:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065536512:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938218.034512:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938218.034552:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065536512:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 79us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938218.034559:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 80 00000100:00080000:2.0:1784938218.034655:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938218.034906:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065536512:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:1.0:1784938218.353379:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938219.382144:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938219.681928:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938219.681978:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938219.682015:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938219.682139:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048780032 00000100:00100000:0.0:1784938219.682148:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048780288 00000100:00100000:1.0:1784938219.682153:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048780032 00000100:00100000:0.0:1784938219.682155:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048780288 00000100:00100000:0.0:1784938219.682295:0:5791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048780160 00000100:00100000:0.0:1784938219.682299:0:5791:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048780160 00000100:00100000:1.0:1784938219.684463:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784938219.684487:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8906c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+12:2357:x1871643048780288:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938219.684527:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938219.684549:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec3953 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a89787f expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938219.684569:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938219.684646:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8906c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+11:2357:x1871643048780288:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 169us (2666us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938219.684654:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784938219.684677:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1784938219.684684:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+10:2357:x1871643048780032:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938219.684692:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938219.684700:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892c00/0xea86628a8aec378c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977d0 expref: 10 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938219.684710:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938219.684742:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+9:2357:x1871643048780032:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 58us (2825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938219.684749:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1784938219.684796:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1784938219.684804:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+8:2357:x1871643048780160:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938219.684814:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938219.684823:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec3793 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977fa expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938219.684832:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938219.684848:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5b339e0-ff01-4453-ac96-ac32d638de32+7:2357:x1871643048780160:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 46us (2834us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938219.684860:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1784938219.690684:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938219.690848:0:7211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048780544 00000100:00100000:0.0:1784938219.690858:0:7211:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048780544 00000100:00100000:0.0:1784938219.690934:0:7211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:0.0:1784938219.690945:0:7211:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+6:2354:x1871643048780544:12345-192.168.201.58@tcp:39:umount.0 00000020:00000080:0.0:1784938219.690987:0:7211:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec37a1 00000020:00010000:0.0:1784938219.690995:0:7211:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa05b01e04800: total 0 00000100:00080000:0.0:1784938219.691000:0:7211:0:(import.c:65:import_set_state_nolock()) ffffa05b01e02000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938219.691021:0:7211:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1784938219.691289:0:7211:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c6a50b74-5d5a-412d-afac-0a1727d8185d+5:2354:x1871643048780544:12345-192.168.201.58@tcp:39:umount.0 Request processed in 346us (614us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1784938219.691298:0:7211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 241 00000020:00010000:1.0:1784938219.691598:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa05b01e04800: total 0 00010000:00010000:1.0:1784938219.691652:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa05b01e04800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784938219.691686:0:5793:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938219.691689:0:5793:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938219.691698:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c200/0xea86628a8aec46ce lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c30 expref: 4 pid: 7211 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938219.691719:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa05b01e04800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1784938219.691729:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938219.691732:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938219.691733:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1784938219.697287:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938219.725733:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938219.727695:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048780800 00000100:00100000:0.0:1784938219.727710:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048780800 00000100:00100000:0.0:1784938219.727792:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 305 00000100:00100000:0.0:1784938219.727817:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+7:2354:x1871643048780800:12345-192.168.201.58@tcp:251:umount.0 00000020:00000080:0.0:1784938219.727865:0:5798:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3697 00000020:00010000:0.0:1784938219.727873:0:5798:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa05aee04d800: total 0 00000100:00080000:0.0:1784938219.727877:0:5798:0:(import.c:65:import_set_state_nolock()) ffffa05aee04c800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1784938219.727958:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87df450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5b339e0-ff01-4453-ac96-ac32d638de32+3:2354:x1871643048780800:12345-192.168.201.58@tcp:251:umount.0 Request processed in 143us (2236us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938219.727968:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 305 00000020:00010000:1.0:1784938219.728266:0:5794:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa05aee04d800: total 0 00010000:00010000:1.0:1784938219.728271:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938219.728315:0:5794:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa05aee04d800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1784938219.728354:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8991000/0xea86628a8aec36eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a8977c2 expref: 2 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938219.728368:0:5794:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa05aee04d800, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1784938219.728379:0:5794:0:(genops.c:906:class_export_put()) final put ffffa05aee04d800/f5b339e0-ff01-4453-ac96-ac32d638de32 00010000:00010000:1.0:1784938219.728394:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938219.728396:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938219.728398:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938219.728497:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05aee04d800/f5b339e0-ff01-4453-ac96-ac32d638de32 for MGS 00000020:00000080:3.0:1784938219.728552:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05aee04c800 for MGS 00000100:00100000:2.0:1784938220.082979:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065536640:0@lo:400:kworker.0 00000100:00100000:2.0:1784938220.083057:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938220.083116:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065537152:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938220.083173:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1784938220.083178:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065536768:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938220.083203:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065537280:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938220.083252:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536640 00000100:00100000:2.0:1784938220.083258:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536640 00000100:00100000:2.0:1784938220.083311:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784938220.083319:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065536640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1784938220.083368:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac87dec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3321:x1871643065536640:12345-0@lo:400:kworker.0 Request processed in 50us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938220.083375:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:2.0:1784938220.083423:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065536640:0@lo:400:kworker.0 00000100:00100000:0.0:1784938220.083656:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938220.083708:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938220.083733:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938220.083758:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536768 00000100:00100000:0.0:1784938220.083761:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536768 00000100:00100000:0.0:1784938220.083790:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537152 00000100:00100000:0.0:1784938220.083793:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537152 00000100:00100000:0.0:1784938220.083820:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 182 00000100:00100000:0.0:1784938220.083827:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065536768:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.083865:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af5378a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065536768:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 38us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938220.083872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 182 00000100:00100000:0.0:1784938220.083885:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 183 00000100:00100000:0.0:1784938220.083892:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065537152:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.083916:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac83e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065537152:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938220.083921:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 183 00000100:00100000:0.0:1784938220.083938:0:8127:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537280 00000100:00100000:0.0:1784938220.083941:0:8127:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537280 00000100:00100000:0.0:1784938220.083980:0:8127:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 108 00000100:00100000:0.0:1784938220.083987:0:8127:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065537280:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.084012:0:8127:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee359f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065537280:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938220.084018:0:8127:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 108 00000100:00080000:0.0:1784938220.084037:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1784938220.084042:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938220.084194:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065536768:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.084205:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065537280:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.084251:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3549180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065537152:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.087665:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065537024:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.087768:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1784938220.087776:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05af4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065536896:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.087978:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938220.088009:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938220.088045:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537024 00000100:00100000:0.0:1784938220.088052:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537024 00000100:00100000:0.0:1784938220.088116:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 109 00000100:00100000:0.0:1784938220.088126:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065537024:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.088175:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee35a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065537024:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 50us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938220.088182:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 109 00000100:00080000:0.0:1784938220.088299:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938220.088330:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065537024:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.091190:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065536896 00000100:00100000:0.0:1784938220.091206:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065536896 00000100:00100000:0.0:1784938220.091299:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 184 00000100:00100000:0.0:1784938220.091308:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065536896:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938220.091379:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065536896:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 73us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938220.091386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 184 00000100:00100000:0.0:1784938220.091571:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05af4fb4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065536896:192.168.201.158@tcp:400:kworker.0 00000100:00080000:2.0:1784938220.091653:0:5800:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784938220.401595:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938220.610270:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065537408:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938220.610561:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938220.610592:0:6607:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537408 00000100:00100000:2.0:1784938220.610600:0:6607:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537408 00000100:00100000:2.0:1784938220.610647:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 81 00000100:00100000:2.0:1784938220.610657:0:6607:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065537408:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:2.0:1784938220.610688:0:6607:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1784938220.610732:0:6607:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065537408:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 74us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938220.610739:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 81 00000100:00100000:2.0:1784938220.610863:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065537408:192.168.201.158@tcp:13:osp-pre-1-0.0 00000001:00100000:1.0:1784938220.665158:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c6a50b74-5d5a-412d-afac-0a1727d8185d 00000001:00080000:1.0:1784938220.665180:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1784938220.665184:0:5828:0:(genops.c:906:class_export_put()) final put ffffa05b01e04800/c6a50b74-5d5a-412d-afac-0a1727d8185d 00000001:00080000:1.0:1784938220.665245:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1784938220.665253:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000001:00080000:1.0:1784938220.665260:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1784938220.665270:0:5828:0:(genops.c:906:class_export_put()) final put ffffa05af52ac000/8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:2.0:1784938220.665461:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05b01e04800/c6a50b74-5d5a-412d-afac-0a1727d8185d for lustre-MDT0000 00000020:00000080:2.0:1784938220.665524:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af52ac000/8bbc0047-63c1-4cac-b5e6-ede401808e2e for lustre-MDT0000 00000020:00000080:2.0:1784938220.665554:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05b01e02000 for lustre-MDT0000 00000020:00000080:2.0:1784938220.665560:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05aee04e000 for lustre-MDT0000 00000001:00100000:2.0:1784938220.667530:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:2.0:1784938220.667541:0:7507:0:(genops.c:906:class_export_put()) final put ffffa05ad09b7000/8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:2.0:1784938220.667571:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ad09b7000/8bbc0047-63c1-4cac-b5e6-ede401808e2e for lustre-OST0001 00000020:00000080:2.0:1784938220.667705:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ad09b6000 for lustre-OST0001 00010000:00010000:0.0:1784938221.425806:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1784938221.628935:0:12933:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:2.0:1784938221.662545:0:12933:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1784938221.662613:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.662633:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.662642:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.662650:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.662679:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1784938221.662686:0:12933:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1784938221.662717:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1784938221.662722:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1784938221.662728:0:12933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1784938221.662757:0:12933:0:(import.c:65:import_set_state_nolock()) ffffa05afc876800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784938221.662875:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065537536:192.168.201.158@tcp:39:umount.0 00010000:00010000:1.0:1784938221.663052:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938221.663071:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.663080:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11aa00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:1.0:1784938221.663084:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.663093:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1784938221.663101:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938221.663106:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1784938221.663109:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1784938221.663112:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1784938221.663147:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.663153:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1784938221.663185:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.663193:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11aa00/0xea86628a8aec372a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3731 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.663241:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938221.663243:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938221.663245:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938221.663291:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065537664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938221.663337:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938221.663491:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537664 00000100:00100000:1.0:1784938221.663499:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537664 00000100:00100000:1.0:1784938221.663564:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1784938221.663573:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3324:x1871643065537664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938221.663586:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938221.663602:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11b600/0xea86628a8aec3731 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec372a expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.663615:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938221.663653:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:3324:x1871643065537664:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.663661:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938221.663741:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065537664:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938221.664195:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938221.664455:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537536 00000100:00100000:1.0:1784938221.664462:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537536 00000100:00100000:1.0:1784938221.664500:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 242 00000100:00100000:1.0:1784938221.664508:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871643065537536:12345-192.168.201.158@tcp:39:umount.0 00000020:00000080:1.0:1784938221.664537:0:5805:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec34a6 00000100:00080000:1.0:1784938221.664546:0:5805:0:(import.c:65:import_set_state_nolock()) ffffa05ac6857000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1784938221.664620:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4fbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3320:x1871643065537536:12345-192.168.201.158@tcp:39:umount.0 Request processed in 112us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.664629:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 242 00000020:00000080:1.0:1784938221.664638:0:5805:0:(genops.c:906:class_export_put()) final put ffffa05ac6851000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784938221.664739:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac6851000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1784938221.664792:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ac6857000 for lustre-MDT0000 00000100:00080000:0.0:1784938221.664894:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05afc876800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1784938221.664917:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065537536:192.168.201.158@tcp:39:umount.0 00000100:00080000:1.0:1784938221.665990:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938221.665997:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938221.666003:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784938221.666976:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.666993:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667001:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667008:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667036:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938221.667043:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667050:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667067:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667073:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667081:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938221.667087:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667111:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667118:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667125:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667133:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1784938221.667138:0:12933:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667145:0:12933:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667152:0:12933:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667159:0:12933:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938221.667166:0:12933:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1784938221.667169:0:12933:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1784938221.667196:0:12933:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1784938221.667200:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1784938221.667204:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938221.667209:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1784938221.667245:0:12933:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa05b01e04000 lustre-MDT0000-lwp-OST0001_UUID 192.168.201.158@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938221.667258:0:12933:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffffa05af4efe000 lustre-MDT0000-lwp-OST0000_UUID 192.168.201.158@tcp 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1784938221.667264:0:12933:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffffa05afbebb380) has exports, disconnecting them 00000020:00080000:1.0:1784938221.667268:0:12933:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.158@tcp (ffffa05b01e04000), last request at 1784938220 00000020:00000080:1.0:1784938221.667275:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3619 00000100:00080000:1.0:1784938221.667297:0:12933:0:(import.c:65:import_set_state_nolock()) ffffa05b01e06800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784938221.667348:0:12933:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.158@tcp (ffffa05b01e04000): rc 0 00000020:00000080:1.0:1784938221.667351:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05b01e04000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1784938221.667362:0:12933:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 192.168.201.158@tcp (ffffa05af4efe000), last request at 1784938220 00000020:00000080:1.0:1784938221.667366:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec354e 00000100:00080000:1.0:1784938221.667371:0:12933:0:(import.c:65:import_set_state_nolock()) ffffa05af4ef8800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1784938221.667378:0:12933:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.158@tcp (ffffa05af4efe000): rc 0 00000020:00000080:1.0:1784938221.667380:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05af4efe000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1784938221.667387:0:12933:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb7b30192fae0 00000100:00080000:1.0:1784938221.667409:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1784938221.667413:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1784938221.667427:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784938221.667503:0:12933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1784938221.667527:0:12933:0:(import.c:65:import_set_state_nolock()) ffffa05afd336000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1784938221.667542:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1784938221.667545:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1784938221.667552:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1784938221.667612:0:12933:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1784938221.667620:0:12933:0:(import.c:65:import_set_state_nolock()) ffffa059c34f6800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1784938221.667651:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffffa05afbebb380) has no exports 00000100:00100000:0.0:1784938221.667918:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065537792:192.168.201.158@tcp:9:umount.0 00000100:00100000:0.0:1784938221.668025:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065537920:192.168.201.158@tcp:9:umount.0 00010000:00010000:2.0:1784938221.668516:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1784938221.668526:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668536:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021ef600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938221.668540:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668551:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938221.668558:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938221.668565:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938221.668567:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1784938221.668570:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1784938221.668628:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668636:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938221.668655:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668663:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05b021ef600/0xea86628a8aec3738 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec373f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668676:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1784938221.668680:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668697:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938221.668700:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668708:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938221.668715:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938221.668721:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938221.668724:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1784938221.668726:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1784938221.668740:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668746:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938221.668766:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668773:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac8991600/0xea86628a8aec3651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3658 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668787:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938221.668790:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668795:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938221.668799:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668811:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938221.668818:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938221.668823:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1784938221.668826:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1784938221.668828:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1784938221.668842:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668848:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938221.668862:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668919:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0031200/0xea86628a8aec3945 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec394c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668932:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938221.668936:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668942:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938221.668945:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668952:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938221.668969:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938221.668975:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938221.668977:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1784938221.668978:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1784938221.668993:0:5794:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.668999:0:5794:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938221.669005:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.669011:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0031a00/0xea86628a8aec3405 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec340c expref: -99 pid: 5786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938221.669022:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938221.669025:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938221.669027:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938221.669131:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938221.669156:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05b01e04000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1784938221.669243:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af4efe000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1784938221.669304:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05b01e06800 for lustre-MDT0000 00000020:00000080:3.0:1784938221.669311:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05af4ef8800 for lustre-MDT0000 00000100:00100000:3.0:1784938221.669408:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065538304:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938221.669470:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938221.669516:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1784938221.669522:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065538432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938221.669546:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938221.669575:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065538304 00000100:00100000:3.0:1784938221.669582:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065538304 00000100:00100000:3.0:1784938221.669628:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065538432 00000100:00100000:3.0:1784938221.669632:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065538432 00000100:00100000:3.0:1784938221.669656:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938221.669665:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+19:3323:x1871643065538304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938221.669680:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938221.669697:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030800/0xea86628a8aec394c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3945 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.669712:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938221.669749:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+18:3323:x1871643065538304:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.669757:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1784938221.669775:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938221.669782:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:3323:x1871643065538432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938221.669790:0:5790:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938221.669798:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05b021ee000/0xea86628a8aec340c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3405 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938221.669819:0:5790:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938221.669841:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3323:x1871643065538432:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938221.669848:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1784938221.669905:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065538432:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938221.669917:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3323:1871643065538304:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938221.670297:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065538048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938221.670334:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938221.670367:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938221.670374:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065538176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938221.670396:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938221.670435:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065538048 00000100:00100000:0.0:1784938221.670439:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065538048 00000100:00100000:0.0:1784938221.670463:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065538176 00000100:00100000:0.0:1784938221.670466:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065538176 00000100:00100000:0.0:1784938221.670496:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784938221.670503:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+17:3321:x1871643065538048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938221.670512:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938221.670522:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893600/0xea86628a8aec373f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3738 expref: 17 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.670532:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938221.670559:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+16:3321:x1871643065538048:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.670567:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1784938221.670581:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938221.670587:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+15:3321:x1871643065538176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938221.670594:0:8373:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938221.670602:0:8373:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11b200/0xea86628a8aec3658 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3651 expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.670615:0:8373:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938221.670682:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18+14:3321:x1871643065538176:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.670689:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1784938221.670720:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1087800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065538176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938221.670729:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065538048:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938221.677797:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938221.677844:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938221.678178:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537792 00000100:00100000:1.0:1784938221.678201:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537792 00000100:00100000:1.0:1784938221.678274:0:6602:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065537920 00000100:00100000:1.0:1784938221.678278:0:6602:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065537920 00000100:00100000:1.0:1784938221.678302:0:6602:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00100000:1.0:1784938221.678313:0:6602:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3320:x1871643065537792:12345-192.168.201.158@tcp:9:umount.0 00000020:00000080:1.0:1784938221.678345:0:6602:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec359b 00000100:00080000:1.0:1784938221.678355:0:6602:0:(import.c:65:import_set_state_nolock()) ffffa05af4efa000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1784938221.678385:0:6602:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1784938221.678547:0:6605:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 75 00000100:00100000:0.0:1784938221.678566:0:6605:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3320:x1871643065537920:12345-192.168.201.158@tcp:9:umount.0 00000020:00000080:0.0:1784938221.678580:0:6605:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3682 00000100:00080000:0.0:1784938221.678585:0:6605:0:(import.c:65:import_set_state_nolock()) ffffa05aee04b000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1784938221.678614:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1784938221.678946:0:6605:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3320:x1871643065537920:12345-192.168.201.158@tcp:9:umount.0 Request processed in 382us (1100us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938221.678955:0:6605:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 75 00000100:00080000:0.0:1784938221.679143:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa059c34f6800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1784938221.679157:0:3320:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1784938221.679160:0:3320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1784938221.679165:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065537920:192.168.201.158@tcp:9:umount.0 00010000:00010000:0.0:1784938221.679199:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938221.679872:0:6602:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3548000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3320:x1871643065537792:12345-192.168.201.158@tcp:9:umount.0 Request processed in 1557us (2082us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938221.679882:0:6602:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 74 00000100:00080000:3.0:1784938221.680272:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05afd336000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1784938221.680288:0:3320:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1784938221.680291:0:3320:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1784938221.680296:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065537792:192.168.201.158@tcp:9:umount.0 00010000:00010000:2.0:1784938221.680961:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1784938221.686619:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffffa05afbebb380) has no exports 00000020:00000080:3.0:1784938221.753607:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3460 00000020:00000080:3.0:1784938221.753627:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afc8a3800/lustre-QMT0000_UUID 00000020:01000000:3.0:1784938221.753679:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1784938221.753762:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afc8a3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1784938221.753786:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938221.753797:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1784938221.753801:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffffa05afbebcd40) has no exports 00000020:00000080:2.0:1784938221.754506:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3459 00000020:00000080:2.0:1784938221.754514:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afc862000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938221.754581:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afc862000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784938221.754656:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.754665:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1784938221.754668:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afc867000/lustre-QMT0000_UUID 00000020:00000080:2.0:1784938221.754670:0:12933:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afc867000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1784938221.754690:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:2.0:1784938221.754821:0:12933:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ac727bba0 - data ffffa05aecc5f6c0/ffffa05aee2df000 00000020:01000000:2.0:1784938221.754957:0:12933:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ac8eb5a80 - data ffffa05ae5ef3438/ffffa05ac8624800 00000001:00000004:2.0:1784938221.773488:0:12933:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1784938221.859632:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784938221.859643:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1784938221.859669:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938221.859672:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784938221.860308:0:6783:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784938221.860315:0:6783:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1784938221.860327:0:6783:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1784938221.861413:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938221.861420:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1784938221.861430:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938221.861432:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1784938221.862088:0:7840:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1784938221.862094:0:7840:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1784938221.862105:0:7840:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1784938221.910378:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3428 00000020:00000080:2.0:1784938221.910393:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afbec3800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938221.911742:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afbec3800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1784938221.912115:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec343d 00000020:00000080:2.0:1784938221.912124:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afbec1800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784938221.912244:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1784938221.912252:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938221.912261:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938221.912266:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffffa05afbeb8000) has no exports 00000004:01000000:2.0:1784938221.912427:0:12933:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1784938221.912436:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec367b 00000020:00000080:2.0:1784938221.912440:0:12933:0:(genops.c:906:class_export_put()) final put ffffa059c34f2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938221.912854:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afbec1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784938221.912912:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784938221.912917:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938221.912925:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938221.912928:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffffa05ac6b23380) has no exports 00000020:00000080:2.0:1784938221.912936:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3674 00000020:00000080:2.0:1784938221.912942:0:12933:0:(genops.c:906:class_export_put()) final put ffffa059c34f4000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938221.913205:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa059c34f2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784938221.913237:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa059c34f4000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1784938221.913464:0:12933:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784938221.913470:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1784938221.913488:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1784938221.913494:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938221.913497:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938221.913541:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.913549:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938221.913556:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3594 00000020:00000080:2.0:1784938221.913560:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05ac6851800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1784938221.913564:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1784938221.913568:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938221.913571:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938221.913573:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffffa05ae17719c0) has no exports 00000020:00000080:2.0:1784938221.913577:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec358d 00000020:00000080:2.0:1784938221.913580:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afd337000/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1784938221.914001:0:12933:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1784938221.914004:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1784938221.914007:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1784938221.914011:0:12933:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1784938221.914013:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1784938221.914037:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.914042:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938221.914080:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.914084:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938221.914087:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05af41b1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938221.914090:0:12933:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af41b1800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1784938221.914096:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938221.914252:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa059c34f6800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1784938221.914259:0:11402:0:(genops.c:906:class_export_put()) final put ffffa05b01e02800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938221.914261:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05b01e02800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1784938221.914265:0:11402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938221.914321:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac6851800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784938221.914326:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afd337000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938221.914338:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05afd336000 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1784938221.914342:0:11402:0:(genops.c:906:class_export_put()) final put ffffa05af4efd000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938221.914344:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af4efd000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1784938221.914348:0:11402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938221.914514:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3444 00000020:00000080:2.0:1784938221.914520:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afbec0000/lustre-MDD0000_UUID 00000020:01000000:2.0:1784938221.914535:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1784938221.914539:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938221.914545:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1784938221.914548:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffffa05afbeb99c0) has no exports 00000020:00000080:2.0:1784938221.914565:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.914575:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1784938221.914578:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec344b 00000020:00000080:2.0:1784938221.914582:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afbec3000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1784938221.914589:0:12933:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05ac735f800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1784938221.914593:0:12933:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac735f800 3 00000020:01000004:2.0:1784938221.914596:0:12933:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa05ac735f800 from lustre-MDT0000 00000020:00000080:2.0:1784938221.914615:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.914618:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1784938221.914621:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afbec2800/lustre-MDT0000_UUID 00000020:00000080:2.0:1784938221.914623:0:12933:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afbec2800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1784938221.914761:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1784938221.914791:0:12933:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1784938221.914795:0:12933:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1784938221.914798:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1784938221.914801:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938221.914803:0:12933:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938221.914811:0:12933:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffffa05ac8044800 f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938221.914816:0:12933:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffffa05ae172b380) has exports, disconnecting them 00000020:00080000:2.0:1784938221.914819:0:12933:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffffa05ac8044800), last request at 1784937985 00000020:00000080:2.0:1784938221.914833:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec33e9 00000020:00010000:2.0:1784938221.914836:0:12933:0:(genops.c:1942:obd_stale_export_put()) Put export ffffa05ac8044800: total 2 00000100:00080000:2.0:1784938221.914840:0:12933:0:(import.c:65:import_set_state_nolock()) ffffa05ac8047000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1784938221.914886:0:12933:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffffa05ac8044800): rc 0 00000020:00080000:2.0:1784938221.914890:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffffa05ae172b380) has no exports 00000100:00100000:2.0:1784938221.914942:0:5797:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffffa05ac6832000:5797] 0 exiting: rc = 1 00000100:00100000:2.0:1784938221.915088:0:5799:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffffa05ac6833800:5799] 2 exiting: rc = 0 00000020:00000080:1.0:1784938221.915621:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afbec0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1784938221.915626:0:11402:0:(genops.c:906:class_export_put()) final put ffffa05afbec0800/lustre-MDD0000_UUID 00000020:00010000:0.0:1784938221.915745:0:5793:0:(genops.c:1928:obd_stale_export_get()) Get export ffffa05ac8044800: total 2 00010000:00010000:0.0:1784938221.915782:0:5793:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffffa05ac8044800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1784938221.915812:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11bc00/0xea86628a8aec3707 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3700 expref: 9 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915829:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893800/0xea86628a8aec3715 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec370e expref: 8 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915842:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030400/0xea86628a8aec393e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3937 expref: 7 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915853:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05acb11ba00/0xea86628a8aec3723 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec371c expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915863:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8991200/0xea86628a8aec3930 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3929 expref: 5 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915894:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc893c00/0xea86628a8aec374d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec3746 expref: 4 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915904:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac1480600/0xea86628a8aec3501 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec34fa expref: 3 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915918:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8990a00/0xea86628a8aec36f9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xea86628a8aec36f2 expref: 2 pid: 5798 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938221.915928:0:5793:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffffa05ac8044800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1784938221.915941:0:5793:0:(genops.c:906:class_export_put()) final put ffffa05ac8044800/f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 00010000:00010000:0.0:1784938221.915952:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938221.915955:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938221.915956:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938221.915988:0:5798:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffffa05ac6832600:5798] 1 exiting: rc = 0 00000100:00100000:0.0:1784938221.916094:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916103:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916109:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916115:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916121:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916127:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916141:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916148:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916154:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916161:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916168:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916175:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916182:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916189:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916196:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916203:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916244:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916253:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916262:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916271:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916277:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916284:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916291:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916298:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916305:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916312:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916318:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916325:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916332:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916341:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916348:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916354:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916360:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916365:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916373:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916378:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916385:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916390:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916395:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916401:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916407:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916412:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916418:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916424:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916429:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916436:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916441:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916446:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916451:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916455:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916461:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916475:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916481:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916486:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916493:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916499:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916506:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916512:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916518:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916523:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916528:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916536:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916543:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938221.916549:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1784938221.917209:0:12933:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784938221.917287:0:12933:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:1.0:1784938221.917755:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afbec0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1784938221.917764:0:11402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1784938221.917980:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afbec3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938221.917986:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac8044800/f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 for MGS 00000020:00000080:1.0:1784938221.918024:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ac8047000 for MGS 00000020:01000000:0.0:1784938221.918953:0:12933:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ac727b360 - data ffffa05ae92f7360/ffffa05aee2dd800 00000020:01000000:0.0:1784938221.919048:0:12933:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ac3515600 - data ffffa05ae903ae58/ffffa05ae1756c00 00000020:00000080:0.0:1784938221.919572:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec33cd 00000020:00000080:0.0:1784938221.919580:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05ac2fa0000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1784938221.919600:0:12933:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05ac735f800 from MGS, refs=2 00000020:01000004:0.0:1784938221.919604:0:12933:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac735f800 2 00000020:01000004:0.0:1784938221.919608:0:12933:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa05ac735f800 from MGS 00000020:00000080:1.0:1784938221.919781:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac2fa0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1784938221.919817:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938221.919824:0:12933:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1784938221.919827:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05ac2fa2000/MGS 00000020:00000080:0.0:1784938221.919830:0:12933:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac2fa2000/MGS for MGS 00000020:01000000:0.0:1784938221.919835:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1784938221.919890:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1784938221.919895:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938221.919901:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1784938221.919911:0:12933:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffffa05afc871000 lustre-MDT0000-lwp-MDT0000 192.168.201.158@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1784938221.919917:0:12933:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffffa05ac6b219c0) has exports, disconnecting them 00000020:00080000:0.0:1784938221.919922:0:12933:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 192.168.201.158@tcp (ffffa05afc871000), last request at 1784937987 00000020:00000080:0.0:1784938221.919940:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3498 00000020:00080000:0.0:1784938221.919948:0:12933:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.158@tcp (ffffa05afc871000): rc 0 00000020:00000080:0.0:1784938221.919954:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05afc871000/lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1784938221.920595:0:12933:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1784938221.920603:0:12933:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938221.920609:0:12933:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784938221.920616:0:12933:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1784938221.921113:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afc871000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1784938221.921336:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938221.921343:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1784938221.921349:0:12933:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac735f800 1 00000020:00000080:0.0:1784938221.921355:0:12933:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec33bf 00000020:00000080:0.0:1784938221.921361:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05ac2fa2800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1784938221.921366:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1784938221.921370:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938221.921373:0:12933:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938221.921376:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffffa05ad0948000) has no exports 00000020:00000080:1.0:1784938221.921488:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05afc876800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1784938221.921494:0:37:0:(genops.c:906:class_export_put()) final put ffffa05afc871800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1784938221.921496:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afc871800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1784938221.921500:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:1.0:1784938221.921548:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac2fa2800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1784938221.951889:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938221.951906:0:12933:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1784938221.951913:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05ac735c800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1784938221.951918:0:12933:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac735c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1784938221.951925:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1784938221.952087:0:12933:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffffa05ac735b000 00000020:01000000:1.0:1784938221.952110:0:12933:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1784938221.952115:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938221.952119:0:12933:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938221.952123:0:12933:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffffa05ae172cd40) has no exports 00000100:00100000:1.0:1784938221.952238:0:12695:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffffa05ae170c000:12695] 4 exiting: rc = 0 00000100:00100000:1.0:1784938221.952369:0:5805:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffffa05ac6832c00:5805] 1 exiting: rc = 0 00000100:00100000:0.0:1784938221.955475:0:5804:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffffa05ac6832200:5804] 0 exiting: rc = 1 00000100:00100000:0.0:1784938221.955604:0:5806:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffffa05ac6833c00:5806] 2 exiting: rc = 0 00000100:00100000:0.0:1784938221.955751:0:7211:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffffa05ac87c2800:7211] 3 exiting: rc = 0 00000100:00100000:1.0:1784938221.955903:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955913:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955919:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955925:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955941:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955948:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955954:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955960:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955965:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955972:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955978:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955983:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955988:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955992:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.955999:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956004:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956010:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956015:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956021:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956026:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956032:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956038:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956047:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956065:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956071:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956076:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956082:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956089:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956096:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956101:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956107:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956112:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956117:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956150:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956156:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956162:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956168:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956174:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956181:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956186:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956191:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956197:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956203:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956208:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956238:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956244:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956250:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956254:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956260:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956265:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956270:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956275:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956280:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956286:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956292:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956298:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956302:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956308:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956314:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956320:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956325:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956330:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956335:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.956348:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.960877:0:5807:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffffa05ac50e2400:5807] 0 exiting: rc = 1 00000100:00100000:3.0:1784938221.961125:0:5808:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffffa05ac50e3c00:5808] 1 exiting: rc = 0 00000100:00100000:1.0:1784938221.961807:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961819:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961827:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961833:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961854:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961860:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961867:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961873:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961879:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961885:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961892:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961898:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961906:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961912:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961917:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961922:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961927:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961931:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961937:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961943:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961948:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961953:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961957:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961962:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961967:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961972:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961977:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961982:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961988:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961992:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.961998:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962003:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962008:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962014:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962019:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962024:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962030:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962035:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962040:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962063:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962069:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962073:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962078:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962083:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962088:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962093:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962099:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962103:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962108:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962112:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962118:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962123:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962128:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962141:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962146:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962152:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962157:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962162:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962167:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962172:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962178:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962183:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962189:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.962195:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.964970:0:5810:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffffa05ad09ac800:5810] 1 exiting: rc = 0 00000100:00100000:2.0:1784938221.965098:0:5809:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffffa05ac8747600:5809] 0 exiting: rc = 1 00000100:00100000:1.0:1784938221.965280:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965289:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965296:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965302:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965310:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965325:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965331:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965337:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965343:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965347:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965366:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965373:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965379:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965384:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965389:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965395:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965401:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965421:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965427:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965433:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965439:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965445:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965451:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965457:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965462:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965468:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965473:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965482:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965488:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965508:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965515:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965522:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965527:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965533:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965540:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965545:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965551:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965557:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965563:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965570:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965576:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965596:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965604:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965610:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965617:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965758:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965764:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965770:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965779:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965784:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965790:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965795:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965801:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965821:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965828:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965834:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965839:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965844:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965850:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965856:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965862:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965867:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965872:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.965885:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.975906:0:5811:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffffa05af4084200:5811] 0 exiting: rc = 1 00000100:00100000:1.0:1784938221.976027:0:5812:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffffa05ac9b60200:5812] 1 exiting: rc = 0 00000100:00100000:1.0:1784938221.976095:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976103:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976108:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976113:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976117:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976123:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976128:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976199:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976206:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976210:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976280:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976285:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976290:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976296:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976302:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976323:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976329:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976333:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976339:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976344:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976349:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976354:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976359:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976364:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976369:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976374:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976379:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976383:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976388:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976392:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976397:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976401:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976406:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976411:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976416:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976421:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976426:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976430:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976435:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976439:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976444:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976449:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976454:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976458:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976463:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976467:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976471:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976476:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976480:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976484:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976497:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976501:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976506:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976510:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976516:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976521:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976525:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976530:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976536:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976540:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976545:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976550:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976554:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.976559:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.977098:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffffa05af40a6e00:5813] 0 exiting: rc = 1 00000100:00100000:2.0:1784938221.977283:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffffa05af40a7000:5814] 1 exiting: rc = 0 00000100:00100000:1.0:1784938221.978037:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978045:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978059:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978065:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978071:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978077:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978083:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978089:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978094:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978100:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978106:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978111:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978116:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978121:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978128:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978199:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978205:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978210:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978243:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978251:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978267:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978272:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978278:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978282:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978287:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978292:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978296:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978300:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978305:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978310:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978315:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978320:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978325:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978330:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978335:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978341:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978346:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978351:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978357:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978362:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978367:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978372:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978377:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978382:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978387:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978391:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978397:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978403:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978408:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978412:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978418:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978423:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978428:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978433:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978438:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978452:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978456:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978460:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978466:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978472:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978477:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978482:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978488:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.978492:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.979347:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffffa05af40a7a00:5816] 1 exiting: rc = 0 00000100:00100000:3.0:1784938221.979529:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffffa05af40a7400:5815] 0 exiting: rc = 1 00000100:00100000:1.0:1784938221.979974:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.979981:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.979986:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.979991:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.979996:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980001:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980005:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980011:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980016:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980022:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980027:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980031:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980036:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980041:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980045:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980059:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980065:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980069:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980073:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980078:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980083:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980088:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980093:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980098:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980102:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980107:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980124:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980130:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980144:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980149:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980155:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980160:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980165:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980170:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980174:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980179:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980184:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980189:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980194:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980201:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980206:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980244:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980251:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980257:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980262:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980267:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980272:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980277:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980281:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980287:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980293:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980298:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980304:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980309:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980314:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980319:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980323:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980329:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980333:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980338:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980343:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980357:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980362:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.980367:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1784938221.981013:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffffa05af41a3000:5818] 1 exiting: rc = 0 00000100:00100000:2.0:1784938221.981348:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffffa05af40a7c00:5817] 0 exiting: rc = 1 00000100:00100000:0.0:1784938221.982440:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffffa05af41a2800:5819] 2 exiting: rc = 0 00000100:00100000:2.0:1784938221.982618:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982626:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982651:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982658:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982671:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982678:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982685:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982691:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982697:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982704:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982710:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982717:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982723:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982729:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982734:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982741:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982745:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982750:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982755:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982760:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982765:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982771:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982790:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982798:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982804:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982810:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982816:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982823:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982829:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982835:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982841:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982847:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982853:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982872:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982880:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982885:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982891:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982898:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982907:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982912:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982918:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982924:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982929:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982935:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982941:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982947:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982967:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982975:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982983:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982989:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982994:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.982998:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983004:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983009:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983016:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983021:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983026:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983032:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983038:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983044:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983049:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983066:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983072:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938221.983077:0:12933:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1784938221.990403:0:12933:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938221.990417:0:12933:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1784938221.990423:0:12933:0:(genops.c:906:class_export_put()) final put ffffa05ae1676000/MDS_uuid 00000020:00000080:2.0:1784938221.990428:0:12933:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1676000/MDS_uuid for MDS 00000020:01000000:2.0:1784938221.990443:0:12933:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1784938221.990590:0:12933:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:1.0:1784938222.164124:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000020:00000080:1.0:1784938222.164146:0:6628:0:(genops.c:906:class_export_put()) final put ffffa05ae7d12800/8bbc0047-63c1-4cac-b5e6-ede401808e2e 00000001:00100000:1.0:1784938222.164171:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938222.164174:0:6628:0:(genops.c:906:class_export_put()) final put ffffa05ac6a42800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1784938222.164191:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae7d12800/8bbc0047-63c1-4cac-b5e6-ede401808e2e for lustre-OST0000 00000020:00000080:1.0:1784938222.164257:0:11402:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac6a42800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1784938222.164278:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ae7d12000 for lustre-OST0000 00000020:00000080:1.0:1784938222.164283:0:11402:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05af4efa000 for lustre-OST0000 00010000:00010000:2.0:1784938222.449653:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938223.473570:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938224.497913:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938225.215405:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065538560:0@lo:400:kworker.0 00000400:00000100:3.0:1784938225.215465:0:3321:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643065538560 offset 0 length 224: 4 00000100:00100000:3.0:1784938225.215515:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938225.215523:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065538688:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938225.215856:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065538816:192.168.201.158@tcp:400:kworker.0 00000400:00000100:3.0:1784938225.216927:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 12 match 1871643065538688 offset 0 length 224: 4 00000400:00000100:3.0:1784938225.218914:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 12 match 1871643065538816 offset 0 length 224: 4 00000020:01000004:3.0:1784938225.389885:0:13083:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1784938225.402339:0:13083:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1784938225.402392:0:13083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938225.402408:0:13083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938225.402416:0:13083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938225.402424:0:13083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938225.402445:0:13083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1784938225.402451:0:13083:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1784938225.402477:0:13083:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938225.402491:0:13083:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa05b01ddc380 x1871643065538688/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938241 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938225.402508:0:13083:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:3.0:1784938225.402540:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065538688:192.168.201.158@tcp:400:kworker.0 00000100:00080000:3.0:1784938225.402568:0:13083:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1784938225.402590:0:13083:0:(import.c:65:import_set_state_nolock()) ffffa05affd41000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1784938225.402616:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1871643065538944:192.168.201.158@tcp:39:umount.0 00000400:00000100:3.0:1784938225.402843:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 12 match 1871643065538944 offset 0 length 224: 4 00010000:00010000:2.0:1784938225.403182:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938225.403190:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938225.403198:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11ae00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938225.403202:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938225.403211:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938225.403350:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938225.403356:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938225.403359:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784938225.403361:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784938225.403392:0:5793:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938225.403399:0:5793:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1784938225.403440:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065539072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938225.403483:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1784938225.403548:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938225.403556:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11ae00/0xea86628a8aec370e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xea86628a8aec3715 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938225.403569:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938225.403584:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938225.403586:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938225.403681:0:8373:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065539072 00000100:00100000:1.0:1784938225.403689:0:8373:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065539072 00000100:00100000:1.0:1784938225.403765:0:8373:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1784938225.403774:0:8373:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8904050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3324:x1871643065539072:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1784938225.403781:0:8373:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1784938225 with bad export cookie 16899302998930109417 00000100:00100000:0.0:1784938225.413960:0:8373:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8904050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3324:x1871643065539072:12345-0@lo:103:ldlm_bl.0 Request processed in 10177us (10467us total) trans 0 rc -107/-107 00000100:00100000:0.0:1784938225.413975:0:8373:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1784938225.414122:0:3324:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1784938225.414129:0:3324:0:(import.c:65:import_set_state_nolock()) ffffa05ae1674800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1784938225.414132:0:3324:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1784938225.419178:0:3324:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.158@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1784938225.419184:0:3324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784938225.419194:0:3324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa05b01ddd500 x1871643065538560/t0(0) o400->MGC192.168.201.158@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1784938241 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938225.419360:0:3324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa059c1085880 x1871643065539072/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1784938241 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784938225.419371:0:3324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784938225.419374:0:3324:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784938225.419376:0:3324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784938225.419379:0:3324:0:(import.c:65:import_set_state_nolock()) ffffa05ae1674800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938225.419384:0:3324:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 194 00000100:00080000:2.0:1784938225.419392:0:3324:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import ffffa05ae1674800 using connection f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18/0@lo 00000100:00100000:3.0:1784938225.419930:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3321:1871643065538560:0@lo:400:kworker.0 00000100:00100000:3.0:1784938225.420008:0:3324:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05b01ddd500 x1871643065539200/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938225.420065:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3320:1871643065539200:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1784938225.420184:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643065539200 offset 0 length 520: 4 00000100:00100000:3.0:1784938225.420328:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3324:1871643065539072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938225.521498:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1784938225.790536:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1784938225.790548:0:7507:0:(genops.c:906:class_export_put()) final put ffffa05aee04e800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1784938225.791882:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffffa05aee04e800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1784938225.791941:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05aee04b000 for lustre-OST0001 00010000:00010000:2.0:1784938226.545568:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938227.569379:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938228.593367:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938229.618259:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938230.321420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938230.321432:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938230.321593:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938230.321631:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065539328:192.168.201.158@tcp:400:kworker.0 00000400:00000100:1.0:1784938230.322267:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 12 match 1871643065539328 offset 0 length 224: 4 00010000:00010000:2.0:1784938230.641532:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938231.666063:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938232.689512:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938233.713480:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938234.737524:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938235.441380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938235.441392:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1784938235.441545:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065539456:192.168.201.158@tcp:400:kworker.0 00000400:00000100:1.0:1784938235.442021:0:3314:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 12 match 1871643065539456 offset 0 length 224: 4 00010000:00010000:2.0:1784938235.761606:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938235.954359:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938225/real 1784938225] req@ffffa05b01ddd500 x1871643065539200/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938235 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938235.954391:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa05b01ddd500 x1871643065539200/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1784938235 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938235.954404:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938225/real 1784938225] req@ffffa05b01ddc380 x1871643065538944/t0(0) o39->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938235 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938235.954417:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa05b01ddc380 x1871643065538944/t0(0) o39->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938235 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938235.954435:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05ae1674800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938235.954457:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1784938235.954461:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3320:1871643065539200:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:3.0:1784938235.954467:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05affd41000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784938235.954483:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1871643065538944:192.168.201.158@tcp:39:umount.0 00000100:00080000:0.0:1784938235.954710:0:13083:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938235.954715:0:13083:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1784938235.954721:0:13083:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1784938235.955130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1784938235.955135:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:2.0:1784938235.955139:0:8:0:(import.c:65:import_set_state_nolock()) ffffa05ae1674800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938235.955144:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 434 00000100:00080000:2.0:1784938235.955150:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.158@tcp: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1784938235.955156:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import ffffa05ae1674800 using connection f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18/0@lo 00000100:00100000:2.0:1784938235.955186:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c1085c00 x1871643065539584/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1784938235.955412:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3320:1871643065539584:0@lo:250:kworker.0 00000400:00000100:3.0:1784938235.955461:0:3320:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1871643065539584 offset 0 length 520: 4 00010000:00010000:0.0:1784938235.956893:0:13083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956911:0:13083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956919:0:13083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956926:0:13083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956950:0:13083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938235.956957:0:13083:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956965:0:13083:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956972:0:13083:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.956978:0:13083:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.956995:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938235.957002:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938235.957007:0:13083:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1784938235.957012:0:13083:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:3.0:1784938235.957018:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11be00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938235.957022:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.957030:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938235.957033:0:13083:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 10000000:00010000:3.0:1784938235.957037:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000000:0.0:1784938235.957037:0:13083:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1784938235.957041:0:13083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 10000000:01000000:3.0:1784938235.957043:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938235.957045:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00000020:00000080:0.0:1784938235.957046:0:13083:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 10000000:01000000:3.0:1784938235.957048:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00000020:00080000:0.0:1784938235.957050:0:13083:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffffa05ad1a20000) has no exports 00010000:00010000:3.0:1784938235.957059:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:3.0:1784938235.957062:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.957068:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11be00/0xea86628a8aec371c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3723 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1784938235.957073:0:13083:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffffa05ad1a20000) has no exports 00010000:00010000:3.0:1784938235.957080:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938235.957084:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.957089:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d800 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938235.957093:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.957099:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938235.957111:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938235.957116:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938235.957118:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1784938235.957120:0:5793:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1784938235.957125:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:3.0:1784938235.957128:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.957134:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec3937 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec393e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938235.957142:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938235.957144:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938235.957145:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938235.957239:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1784938235.960968:0:13083:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ad82c8420 - data ffffa05b01277798/ffffa05af5366000 00000020:01000000:0.0:1784938235.961146:0:13083:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ac86c8780 - data ffffa05ae5f490d8/ffffa05affeb9400 00100000:10000000:0.0:1784938235.972819:0:13083:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1784938236.016556:0:13083:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec351d 00000020:00000080:3.0:1784938236.016567:0:13083:0:(genops.c:906:class_export_put()) final put ffffa05affa9f000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1784938236.016581:0:13083:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05ac73fb000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1784938236.016585:0:13083:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac73fb000 2 00000020:01000004:3.0:1784938236.016588:0:13083:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa05ac73fb000 from lustre-OST0000 00000020:00000080:3.0:1784938236.016612:0:13083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1784938236.016622:0:13083:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1784938236.016625:0:13083:0:(genops.c:906:class_export_put()) final put ffffa05affa9e800/lustre-OST0000_UUID 00000020:00000080:3.0:1784938236.016628:0:13083:0:(genops.c:865:class_export_destroy()) destroying export ffffa05affa9e800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1784938236.016634:0:13083:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1784938236.016676:0:13083:0:(obd_mount.c:574:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1784938236.016681:0:13083:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1784938236.016685:0:13083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1784938236.016690:0:13083:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1784938236.016708:0:13083:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffffa05affd40800 lustre-MDT0000-lwp-OST0000 192.168.201.158@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1784938236.016715:0:13083:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffffa05ac6b24d40) has exports, disconnecting them 00000020:00080000:3.0:1784938236.016720:0:13083:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 192.168.201.158@tcp (ffffa05affd40800), last request at 1784938004 00000020:00000080:3.0:1784938236.016989:0:13083:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3547 00000020:00080000:3.0:1784938236.017001:0:13083:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.158@tcp (ffffa05affd40800): rc 0 00000020:00000080:3.0:1784938236.017007:0:13083:0:(genops.c:906:class_export_put()) final put ffffa05affd40800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1784938236.017397:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05affa9f000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1784938236.017407:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05affd40800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1784938236.018856:0:13083:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1784938236.018863:0:13083:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1784938236.018867:0:13083:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1784938236.018873:0:13083:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1784938236.019012:0:13083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938236.019021:0:13083:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1784938236.019029:0:13083:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac73fb000 1 00000020:00000080:0.0:1784938236.019035:0:13083:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec34d7 00000020:00000080:0.0:1784938236.019042:0:13083:0:(genops.c:906:class_export_put()) final put ffffa05afb439000/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1784938236.019048:0:13083:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1784938236.019054:0:13083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938236.019057:0:13083:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938236.019061:0:13083:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffffa05ae1728000) has no exports 00000020:00000080:1.0:1784938236.020382:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05affd41000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1784938236.020516:0:8:0:(genops.c:906:class_export_put()) final put ffffa05afd333000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1784938236.020521:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afd333000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1784938236.020536:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1784938236.020604:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afb439000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1784938236.091642:0:13083:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1784938236.091661:0:13083:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1784938236.091668:0:13083:0:(genops.c:906:class_export_put()) final put ffffa05ac73fe800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1784938236.091673:0:13083:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac73fe800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1784938236.091699:0:13083:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1784938236.091875:0:13083:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffffa05ac73fd000 00000020:02000400:1.0:1784938236.091981:0:13083:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1784938236.792809:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938237.810541:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938238.840772:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1784938239.316640:0:13238:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1784938239.342016:0:13238:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1784938239.342185:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938239.342201:0:13238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938239.342210:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938239.342346:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938239.342748:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1784938239.342767:0:13238:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1784938239.342800:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938239.342815:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa05b01dddc00 x1871643065538816/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938241 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938239.342849:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa059c1084a80 x1871643065539328/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938246 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938239.342866:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa059c1084380 x1871643065539456/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938251 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938239.342873:0:13238:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1784938239.342880:0:13238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938239.342906:0:13238:0:(import.c:65:import_set_state_nolock()) ffffa05b01e05000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1784938239.343053:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065539456:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938239.343062:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3322:1871643065539328:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938239.343258:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065538816:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938239.343286:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1871643065539712:192.168.201.158@tcp:39:umount.0 00000400:00000100:0.0:1784938239.343697:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 12 match 1871643065539712 offset 0 length 224: 4 00010000:00010000:2.0:1784938239.345011:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938239.345094:0:5794:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938239.345107:0:5794:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05b021efa00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938239.345112:0:5794:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938239.345123:0:5794:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938239.345130:0:5794:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938239.345151:0:5794:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938239.345154:0:5794:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1784938239.345157:0:5794:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1784938239.345177:0:5794:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:2.0:1784938239.345181:0:5794:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938239.345187:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05b021efa00/0xea86628a8aec36f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec36f9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938239.345203:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938239.345205:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938239.345207:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938239.857820:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938240.881432:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938241.073576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1784938241.073590:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1784938241.906298:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938242.929683:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938243.953925:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938244.977515:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938246.001517:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938246.194788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1784938246.194816:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1784938247.025810:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938248.050267:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938249.073565:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938249.585368:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938239/real 1784938239] req@ffffa059c3549880 x1871643065539712/t0(0) o39->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938249 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938249.585405:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa059c3549880 x1871643065539712/t0(0) o39->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 1 dl 1784938249 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938249.585425:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05b01e05000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1784938249.585447:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1871643065539712:192.168.201.158@tcp:39:umount.0 00000100:00080000:1.0:1784938249.585542:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1784938249.585547:0:13238:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1784938249.585552:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1784938249.586620:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.586640:0:13238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.586647:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.586654:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.587195:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938249.587206:0:13238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.587240:0:13238:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.587247:0:13238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938249.587253:0:13238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599033:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938249.599049:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599087:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05acb11a200 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938249.599092:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599104:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938249.599111:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938249.599129:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1784938249.599132:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1784938249.599147:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:3.0:1784938249.599151:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599159:0:5793:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05acb11a200/0xea86628a8aec3700 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3707 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599186:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938249.599191:0:5793:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599197:0:5793:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87cc00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938249.599200:0:5793:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599207:0:5793:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938249.599269:0:5793:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938249.599274:0:5793:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1784938249.599276:0:5793:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1784938249.599282:0:5793:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:3.0:1784938249.599284:0:5793:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938249.599292:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938249.599294:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938249.599296:0:5793:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938249.607736:0:13238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1784938249.607768:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87cc00/0xea86628a8aec3929 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3930 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938249.607795:0:13238:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:1.0:1784938249.607803:0:13238:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:1.0:1784938249.607806:0:13238:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1784938249.607859:0:13238:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1784938249.607865:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1784938249.607886:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1784938249.607900:0:13238:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1784938249.607905:0:13238:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffffa05ad1a23380) has no exports 00000020:00080000:1.0:1784938249.607932:0:13238:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffffa05ad1a23380) has no exports 00010000:00010000:2.0:1784938249.630468:0:5794:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1784938249.636739:0:13238:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05ac50f3a80 - data ffffa05b01277870/ffffa05af5365800 00000020:01000000:1.0:1784938249.636876:0:13238:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffffa05adee23360 - data ffffa05ae92f71b0/ffffa05aee045800 00100000:10000000:1.0:1784938249.651287:0:13238:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1784938249.702967:0:13238:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec35e8 00000020:00000080:2.0:1784938249.702980:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05af409b800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1784938249.703004:0:13238:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05ac7f16000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1784938249.703009:0:13238:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac7f16000 2 00000020:01000004:2.0:1784938249.703012:0:13238:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffffa05ac7f16000 from lustre-OST0001 00000020:00000080:2.0:1784938249.703049:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938249.703062:0:13238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1784938249.703065:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05af4eff800/lustre-OST0001_UUID 00000020:00000080:2.0:1784938249.703068:0:13238:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af4eff800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1784938249.703076:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:0.0:1784938249.703351:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af409b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1784938249.703422:0:13238:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18->MGS 00010000:00010000:2.0:1784938249.703457:0:13238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938249.703471:0:13238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938249.703477:0:13238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1784938249.703480:0:13238:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1784938249.703485:0:13238:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1784938249.703504:0:13238:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:2.0:1784938249.703508:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05afc892400/0xea86628a8aec34fa lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec3501 expref: -99 pid: 6601 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938249.703526:0:13238:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938249.703533:0:13238:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938249.703537:0:13238:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1784938249.703539:0:13238:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1784938249.703541:0:13238:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1784938249.703551:0:13238:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffffa05ae1674800 00010000:00010000:2.0:1784938249.703553:0:13238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05b021ef400/0xea86628a8aec3746 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xea86628a8aec374d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1784938249.703571:0:13238:0:(import.c:65:import_set_state_nolock()) ffffa05ae1674800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1784938249.703586:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1784938249.703589:0:13238:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1784938249.703591:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1784938249.703596:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1784938249.703609:0:13238:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffffa059c1085c00 x1871643065539584/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1784938250 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1784938249.703769:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784938249.703773:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:0.0:1784938249.704565:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18:3320:1871643065539584:0@lo:250:kworker.0 10000000:01000000:2.0:1784938249.704937:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784938249.704946:0:13238:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec33db 00000020:00000080:2.0:1784938249.704953:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05ae1677000/f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 00000020:01000000:2.0:1784938249.704972:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.158@tcp (flags='') 00000020:00000080:2.0:1784938249.704978:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938249.704984:0:13238:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1784938249.704988:0:13238:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffffa05ae17299c0) has no exports 10000000:01000000:2.0:1784938249.705007:0:5802:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1784938249.705085:0:13238:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.158@tcp: client import never connected 00000100:00080000:2.0:1784938249.705088:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1784938249.705091:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1784938249.705093:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1784938249.705095:0:13238:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1784938249.705126:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1784938249.705131:0:13238:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.158@tcp (uuid f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18) 00000020:01000000:2.0:1784938249.705136:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1784938249.705139:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1784938249.705142:0:13238:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1784938249.705151:0:13238:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffffa05af52a8800 lustre-MDT0000-lwp-OST0001 192.168.201.158@tcp 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1784938249.705156:0:13238:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffffa05ac6b20000) has exports, disconnecting them 00000020:00080000:2.0:1784938249.705160:0:13238:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 192.168.201.158@tcp (ffffa05af52a8800), last request at 1784938023 00000020:00000080:2.0:1784938249.705164:0:13238:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec3612 00000020:00080000:2.0:1784938249.705176:0:13238:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 192.168.201.158@tcp (ffffa05af52a8800): rc 0 00000020:00000080:2.0:1784938249.705180:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05af52a8800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784938249.705920:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1677000/f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 for MGC192.168.201.158@tcp 00000020:00000080:3.0:1784938249.705937:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05af52a8800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1784938249.706640:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05ae1674800 for MGC192.168.201.158@tcp 00000020:00000080:3.0:1784938249.706649:0:8:0:(genops.c:906:class_export_put()) final put ffffa05ae1670800/f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 00000020:00000080:3.0:1784938249.706652:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1670800/f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18 for MGC192.168.201.158@tcp 00000020:01000000:3.0:1784938249.706667:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.158@tcp (f5aa56fd-d33b-4e6c-8b2f-129f5ad73c18) 00010000:01000000:3.0:1784938249.783379:0:13238:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1784938249.783390:0:13238:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1784938249.783394:0:13238:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1784938249.783403:0:13238:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1784938249.783471:0:5793:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1784938249.783634:0:5794:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1784938249.783737:0:5789:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffffa05ae7c8e800:5789] 1 exiting: rc = 0 00000100:00100000:0.0:1784938249.783943:0:5788:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffffa05ad09acc00:5788] 0 exiting: rc = 1 00000020:00000080:0.0:1784938249.783993:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffffa05b01e05000 for lustre-MDT0000-lwp-OST0001 00000100:00100000:3.0:1784938249.784529:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.784923:0:5790:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffffa05ac4bcce00:5790] 0 exiting: rc = 1 00000100:00100000:0.0:1784938249.784987:0:8373:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffffa05ac49ef800:8373] 3 exiting: rc = 0 00000100:00100000:3.0:1784938249.786321:0:5791:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffffa05ac4bcd000:5791] 1 exiting: rc = 0 00000100:00100000:3.0:1784938249.788506:0:5792:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffffa05ac4bcd200:5792] 2 exiting: rc = 0 00000100:00100000:0.0:1784938249.801731:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801744:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801752:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801759:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801765:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801771:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801778:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801785:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801791:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801797:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801807:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801831:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801843:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801856:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801865:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801876:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801886:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801897:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801906:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801915:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801924:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801964:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.801972:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802100:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802115:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802123:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802131:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802139:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802148:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802157:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.802166:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803422:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803435:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803441:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803446:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803451:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803457:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803462:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803467:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803473:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803478:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803483:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803488:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803493:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803498:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803505:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803510:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803515:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803520:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803525:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803529:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803535:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803541:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803546:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803551:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803556:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803583:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803589:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803594:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803599:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803603:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803608:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803612:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.803617:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1784938249.829462:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938249.829480:0:13238:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1784938249.829487:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05b01e03000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1784938249.829492:0:13238:0:(genops.c:865:class_export_destroy()) destroying export ffffa05b01e03000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1784938249.829509:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1784938249.829599:0:13238:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05ac7f16000 1 00000020:00000080:0.0:1784938249.829607:0:13238:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xea86628a8aec35b7 00000020:00000080:0.0:1784938249.829614:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05ae1722800/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1784938249.829636:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1784938249.829641:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938249.829647:0:13238:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1784938249.829651:0:13238:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffffa05ad094b380) has no exports 00000020:00000080:3.0:1784938249.831081:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ae1722800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1784938249.867520:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938249.867539:0:13238:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1784938249.867545:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05ac7f12000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1784938249.867551:0:13238:0:(genops.c:865:class_export_destroy()) destroying export ffffa05ac7f12000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1784938249.867559:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1784938249.867783:0:13238:0:(obd_mount.c:664:lustre_free_lsi()) Freeing lsi ffffa05ac7f11800 00000020:01000000:0.0:1784938249.867807:0:13238:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1784938249.867811:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1784938249.867815:0:13238:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1784938249.867819:0:13238:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffffa05ad1a24d40) has no exports 00000020:00000080:0.0:1784938249.867844:0:13238:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1784938249.867851:0:13238:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1784938249.867854:0:13238:0:(genops.c:906:class_export_put()) final put ffffa05afb438800/OSS_uuid 00000020:00000080:0.0:1784938249.867867:0:13238:0:(genops.c:865:class_export_destroy()) destroying export ffffa05afb438800/OSS_uuid for OSS 00000020:01000000:0.0:1784938249.867870:0:13238:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1784938249.867900:0:5800:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1784938249.868352:0:6604:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffffa05ad8115000:6604] 1 exiting: rc = 0 00000100:00100000:0.0:1784938249.868406:0:6605:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffffa05ac8c97200:6605] 2 exiting: rc = 0 00000100:00100000:2.0:1784938249.869336:0:8127:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffffa05aee272400:8127] 3 exiting: rc = 0 00000100:00100000:1.0:1784938249.869812:0:6602:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffffa05ae7c8fc00:6602] 0 exiting: rc = 1 00000100:00100000:0.0:1784938249.871700:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871715:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871724:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871732:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871738:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871744:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871749:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871754:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871760:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871765:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871770:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871775:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871781:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871786:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871793:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871797:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871801:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871806:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871812:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871818:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871824:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871829:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871834:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871839:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871845:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871849:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871854:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871859:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871863:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871868:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871886:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871890:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871895:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871901:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871906:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871911:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871916:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871921:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871926:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871931:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871935:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871940:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871945:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871950:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871954:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871959:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871964:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.871969:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872115:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872125:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872130:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872136:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872157:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872171:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872176:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872181:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872186:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872191:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872196:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872200:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872205:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872210:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872238:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.872245:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1784938249.874078:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffffa05ac8c97600:6606] 0 exiting: rc = 1 00000100:00100000:2.0:1784938249.874205:0:6607:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffffa05ac8c96800:6607] 1 exiting: rc = 0 00000100:00100000:0.0:1784938249.875772:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875799:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875806:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875812:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875819:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875826:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875831:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875838:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875844:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875849:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875855:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875860:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875866:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875871:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875876:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875881:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875886:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875892:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875898:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875903:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875909:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875915:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875921:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875928:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875933:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875939:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875944:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875951:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875957:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875962:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875967:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875972:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875989:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.875995:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876001:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876007:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876021:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876028:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876034:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876040:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876046:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876052:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876059:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876065:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876071:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876077:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876082:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876089:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876095:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876102:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876108:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876114:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876120:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876126:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876132:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876139:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876145:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876151:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876157:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876163:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876181:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876187:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876194:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.876211:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.877624:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffffa05aedfd0c00:6610] 2 exiting: rc = 0 00000100:00100000:0.0:1784938249.877974:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffffa05aedfd1e00:6609] 1 exiting: rc = 0 00000100:00100000:1.0:1784938249.882429:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffffa05aedfd1c00:6608] 0 exiting: rc = 1 00000100:00100000:0.0:1784938249.885020:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885033:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885040:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885046:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885054:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885079:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885087:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885096:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885103:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885111:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885119:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885126:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885133:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885139:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885145:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885152:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885158:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885175:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885183:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885191:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885199:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885207:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885429:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885438:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885444:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885450:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885456:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885462:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885487:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885495:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885501:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885506:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885512:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885519:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885526:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885532:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885539:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885546:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885552:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885559:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885585:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885757:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885766:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885773:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885779:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885786:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885796:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885802:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885808:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885815:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885822:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885828:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885851:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885859:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885865:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885871:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885878:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885884:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885890:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885896:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885902:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885908:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885914:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.885921:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938249.893367:0:6612:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffffa05ac83a0000:6612] 1 exiting: rc = 0 00000100:00100000:2.0:1784938249.897157:0:6611:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffffa05aedfd1200:6611] 0 exiting: rc = 1 00000100:00100000:0.0:1784938249.900523:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900534:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900541:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900547:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900553:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900558:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900565:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900584:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900590:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900596:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900602:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900628:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900634:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900639:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900645:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900651:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900667:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900671:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900677:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900682:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900687:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900692:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900700:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900708:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900715:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900721:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900726:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900732:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900737:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900741:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900746:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900751:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900756:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900761:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900767:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900772:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900777:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900783:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900789:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900794:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900799:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900804:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900809:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900814:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900820:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900825:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900840:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900845:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900850:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900855:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900860:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900865:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900870:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900888:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900894:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900899:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900904:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900910:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900915:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900921:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900927:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900933:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900939:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.900945:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1784938249.902351:0:6613:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffffa05ac50e2e00:6613] 0 exiting: rc = 1 00000100:00100000:2.0:1784938249.902552:0:6614:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffffa05ac50e3000:6614] 1 exiting: rc = 0 00000100:00100000:0.0:1784938249.902609:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902617:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902633:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902640:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902647:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902716:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902727:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902733:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902740:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902745:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902752:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902769:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902776:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902781:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902788:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902793:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902799:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902816:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902824:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902831:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902838:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902844:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902851:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902933:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902943:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902950:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902956:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902962:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902967:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902973:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902979:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902986:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.902992:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903002:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903009:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903029:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903037:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903042:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903048:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903055:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903063:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903070:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903079:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903087:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903093:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903101:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903109:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903132:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903138:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903144:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903150:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903156:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903320:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903329:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903336:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903342:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903347:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903353:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903360:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903384:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903392:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903399:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903407:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1784938249.903422:0:13238:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1784938249.917810:0:13238:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1784938268.676460:0:13856:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1784938277.961383:0:14270:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:2.0:1784938277.961391:0:14270:0:(obd_mount.c:922:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1784938277.961581:0:14270:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa05aff9ff000 00000020:01000004:2.0:1784938277.961605:0:14270:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1784938277.961616:0:14270:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1784938277.961650:0:14270:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffffa05ad1a23380) 00000020:00000080:2.0:1784938277.961674:0:14270:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1784938277.991005:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1784938277.998355:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1784938277.998840:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 539: rc = 0 00100000:10000000:1.0:1784938277.998941:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 539: rc = 0 00100000:10000000:1.0:1784938277.999038:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 539: rc = 0 00100000:10000000:1.0:1784938277.999272:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 539: rc = 0 00100000:10000000:1.0:1784938277.999374:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 539: rc = 0 00100000:10000000:1.0:1784938277.999715:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1784938277.999779:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 539: rc = 0 00100000:10000000:1.0:1784938278.000033:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 541: rc = 0 00100000:10000000:1.0:1784938278.011086:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 77: rc = 0 00100000:10000000:1.0:1784938278.012865:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 77: rc = 0 00100000:10000000:1.0:1784938278.015034:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 84: rc = 0 00100000:10000000:1.0:1784938278.016937:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 84: rc = 0 00100000:10000000:2.0:1784938278.025684:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 84: rc = 0 00100000:10000000:3.0:1784938278.027561:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 84: rc = 0 00100000:10000000:3.0:1784938278.027880:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 84: rc = 0 00100000:10000000:3.0:1784938278.028104:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 84: rc = 0 00100000:10000000:3.0:1784938278.028356:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 84: rc = 0 00100000:10000000:3.0:1784938278.028618:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 84: rc = 0 00100000:10000000:3.0:1784938278.028845:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 84: rc = 0 00100000:10000000:3.0:1784938278.029079:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 84: rc = 0 00100000:10000000:3.0:1784938278.029467:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 84: rc = 0 00100000:10000000:3.0:1784938278.029713:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 84: rc = 0 00100000:10000000:3.0:1784938278.031171:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 439: rc = 0 00100000:10000000:3.0:1784938278.031811:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 439: rc = 0 00100000:10000000:3.0:1784938278.032068:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 439: rc = 0 00100000:10000000:3.0:1784938278.033103:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 439: rc = 0 00100000:10000000:3.0:1784938278.033959:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 439: rc = 0 00100000:10000000:3.0:1784938278.035028:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 439: rc = 0 00100000:10000000:3.0:1784938278.035762:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 439: rc = 0 00100000:10000000:3.0:1784938278.036026:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 439: rc = 0 00100000:10000000:3.0:1784938278.036424:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 439: rc = 0 00100000:10000000:3.0:1784938278.036922:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 439: rc = 0 00100000:10000000:3.0:1784938278.037183:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 439: rc = 0 00100000:10000000:3.0:1784938278.037659:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 439: rc = 0 00100000:10000000:3.0:1784938278.038025:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 439: rc = 0 00100000:10000000:3.0:1784938278.039271:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 439: rc = 0 00100000:10000000:3.0:1784938278.039955:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 439: rc = 0 00100000:10000000:3.0:1784938278.040253:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 439: rc = 0 00100000:10000000:3.0:1784938278.041175:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 439: rc = 0 00100000:10000000:3.0:1784938278.041515:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 439: rc = 0 00100000:10000000:3.0:1784938278.041844:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 439: rc = 0 00100000:10000000:3.0:1784938278.042114:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 439: rc = 0 00100000:10000000:3.0:1784938278.042495:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 439: rc = 0 00100000:10000000:3.0:1784938278.042878:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 439: rc = 0 00100000:10000000:3.0:1784938278.043167:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 439: rc = 0 00100000:10000000:3.0:1784938278.043671:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 439: rc = 0 00100000:10000000:3.0:1784938278.043969:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 439: rc = 0 00100000:10000000:3.0:1784938278.044281:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 439: rc = 0 00100000:10000000:3.0:1784938278.046141:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 439: rc = 0 00100000:10000000:3.0:1784938278.046452:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 439: rc = 0 00100000:10000000:3.0:1784938278.046654:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 439: rc = 0 00100000:10000000:3.0:1784938278.047023:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 439: rc = 0 00100000:10000000:3.0:1784938278.048908:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 439: rc = 0 00100000:10000000:3.0:1784938278.049660:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 439: rc = 0 00100000:10000000:3.0:1784938278.050205:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 619: rc = 0 00100000:10000000:3.0:1784938278.052902:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1784938278.053123:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 78: rc = 0 00100000:10000000:3.0:1784938278.053512:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1784938278.053851:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 78: rc = 0 00100000:10000000:3.0:1784938278.054046:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1784938278.054124:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 78: rc = 0 00100000:10000000:3.0:1784938278.056037:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1784938278.056144:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 615: rc = 0 00100000:10000000:3.0:1784938278.056770:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1784938278.056855:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 615: rc = 0 00100000:10000000:3.0:1784938278.057056:0:14270:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1784938278.057134:0:14270:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 615: rc = 0 00000020:00000080:3.0:1784938278.058521:0:14270:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1784938278.058534:0:14270:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784938278.058549:0:14270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec46dc 00000020:01000004:3.0:1784938278.058559:0:14270:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1784938278.058565:0:14270:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1784938278.058643:0:14270:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa05aff9ff000 from MGS 00000020:01000004:3.0:1784938278.058647:0:14270:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1784938278.058661:0:14270:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffffa05ad09499c0) 00000020:00000080:3.0:1784938278.058674:0:14270:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1784938278.058813:0:14270:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05aff9ff000 from MGS, refs=2 00080000:01000000:3.0:1784938278.058819:0:14270:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1784938278.058825:0:14270:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec46ea 00000100:00100000:3.0:1784938278.059018:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1784938278.059187:0:14270:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1784938278.059195:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1784938278.060055:0:14270:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1784938278.060064:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1784938278.062204:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1784938278.063008:0:14270:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1784938278.063016:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1784938278.064131:0:14270:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1784938278.064141:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1784938278.064822:0:14270:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1784938278.064830:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1784938278.066828:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.066833:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.066835:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.069428:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.069435:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.069438:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938278.070522:0:14270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1784938278.071962:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1784938278.106602:0:14270:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1784938278.106637:0:14270:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1784938278.106640:0:14270:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1784938278.114673:0:14279:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1784938278.115026:0:14270:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1784938278.115607:0:14270:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938278.117589:0:14270:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1784938278.118559:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938278.119067:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1784938278.119074:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1784938278.133374:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1784938278.133391:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1784938278.136103:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1784938278.136126:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1784938278.137588:0:14284:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1784938278.137645:0:14270:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1784938278.137676:0:14270:0:(obd_mount.c:414:lustre_start_mgc()) Start MGC 'MGC192.168.201.158@tcp' 00000020:01000004:2.0:1784938278.137679:0:14270:0:(obd_mount.c:423:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1784938278.137780:0:14270:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MGC192.168.201.158@tcp (typ=mgc) 00000020:00000080:2.0:1784938278.137795:0:14270:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.158@tcp (ffffa05ad1a219c0) 00000020:00000080:2.0:1784938278.137878:0:14270:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1784938278.138050:0:14270:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05ac83e9000@MGC192.168.201.158@tcp: add connection 0@lo at head 00010000:00010000:2.0:1784938278.138516:0:14270:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.158@tcp-0 is initialized 00000040:01000000:2.0:1784938278.138526:0:14270:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 1 is initialized 10000000:01000000:2.0:1784938278.139587:0:14285:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1784938278.139670:0:14270:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.158@tcp (uuid d8a94b82-749f-4608-8cc0-c15cba2ced0a) 00000020:00000080:1.0:1784938278.139717:0:14270:0:(genops.c:1406:class_connect()) connect: client d8a94b82-749f-4608-8cc0-c15cba2ced0a, cookie 0xea86628a8aec46f8 00000100:00080000:1.0:1784938278.139730:0:14270:0:(import.c:510:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1784938278.139737:0:14270:0:(import.c:624:import_select_connection()) MGC192.168.201.158@tcp: import ffffa05ac83e9000 using connection d8a94b82-749f-4608-8cc0-c15cba2ced0a/0@lo 00000100:00100000:1.0:1784938278.139775:0:14270:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c3548a80 x1871643065539840/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938278.140044:0:14270:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import d8a94b82-749f-4608-8cc0-c15cba2ced0a->MGS 00000020:01000004:1.0:1784938278.140064:0:14270:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1784938278.140071:0:14270:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1784938278.140085:0:14270:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffffa05ae17719c0) 00000020:00000080:1.0:1784938278.140108:0:14270:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1784938278.140329:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3320:1871643065539840:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1784938278.140433:0:3320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.140518:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065539840 00000100:00100000:2.0:1784938278.140525:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065539840 00000100:00100000:2.0:1784938278.140570:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938278.140579:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3320:x1871643065539840:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1784938278.140607:0:14280:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from d8a94b82-749f-4608-8cc0-c15cba2ced0a@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:2.0:1784938278.140632:0:14280:0:(genops.c:1406:class_connect()) connect: client d8a94b82-749f-4608-8cc0-c15cba2ced0a, cookie 0xea86628a8aec4706 00000100:00080000:2.0:1784938278.140790:0:14280:0:(import.c:65:import_set_state_nolock()) ffffa05ac7f12000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938278.141368:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+5:3320:x1871643065539840:12345-0@lo:250:mount.lustre.0 Request processed in 788us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.141378:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938278.141435:0:3320:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.201.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1784938278.141444:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.158@tcp: connect to target with instance 0 00000100:00080000:2.0:1784938278.141453:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1784938278.141458:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1784938278.141462:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05ac83e9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1784938278.141465:0:3320:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1784938278.141475:0:3320:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1784938278.141481:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3320:1871643065539840:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1784938278.174546:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938278.176440:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1784938278.176455:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1784938278.183517:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1784938278.183533:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1784938278.185561:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1784938278.185580:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1784938278.188787:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1784938278.188999:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1784938278.189005:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1784938278.191075:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1784938278.191099:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1784938278.282029:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938278.282363:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1784938278.282370:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1784938278.283458:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1784938278.283469:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1784938278.283962:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938278.284134:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938278.284139:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1784938278.284816:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938278.284823:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1784938278.285417:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938278.285558:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938278.285562:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1784938278.286933:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938278.286944:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1784938278.287554:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938278.287716:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1784938278.287721:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1784938278.291966:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1784938278.291987:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1784938278.354526:0:14270:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938278.355472:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1784938278.355482:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1784938278.360106:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938278.360123:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1784938278.361586:0:14270:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784938278.361601:0:14270:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1784938278.370489:0:14270:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1784938278.370520:0:14270:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1784938278.370526:0:14270:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1784938278.370690:0:14270:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1784938278.370752:0:14270:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20005 00000020:01000004:3.0:1784938278.370757:0:14270:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1784938278.370758:0:14270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938278.370760:0:14270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938278.370761:0:14270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938278.370762:0:14270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938278.370763:0:14270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938278.370765:0:14270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938278.370766:0:14270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938278.370768:0:14270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938278.370770:0:14270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938278.370773:0:14270:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:3.0:1784938278.370775:0:14270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1784938278.370776:0:14270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938278.370777:0:14270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938278.370783:0:14270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938278.370784:0:14270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938278.370786:0:14270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938278.370786:0:14270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938278.370787:0:14270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938278.370788:0:14270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938278.370789:0:14270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1784938278.370830:0:14270:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1784938278.370851:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065539968:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1784938278.370928:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.372569:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938278.372729:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065539968 00000100:00100000:0.0:1784938278.372739:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065539968 00000100:00100000:0.0:1784938278.373022:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1784938278.373037:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+5:14270:x1871643065539968:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1784938278.373106:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1784938278.373109:0:14283:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1784938278.373113:0:14283:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1784938278.375153:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1784938278.375981:0:14283:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1784938278.378002:0:14305:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1784938278.378012:0:14305:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1784938278.378015:0:14305:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1784938278.378050:0:14305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:1.0:1784938278.379051:0:14283:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1784938278.379069:0:14283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1784938278.404123:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+5:14270:x1871643065539968:12345-0@lo:253:mount.lustre.0 Request processed in 31073us (33178us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.404153:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1784938278.404376:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065539968:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1784938278.404396:0:14270:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1784938278.404401:0:14270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1784938278.404403:0:14270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1784938278.404404:0:14270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1784938278.404405:0:14270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1784938278.404406:0:14270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1784938278.404408:0:14270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1784938278.404409:0:14270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1784938278.404411:0:14270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1784938278.404414:0:14270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1784938278.404415:0:14270:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1784938278.404447:0:14270:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa05aff9ff000 from lustre-MDT0000 10000000:01000000:3.0:1784938278.404484:0:14270:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1784938278.404488:0:14270:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784938278.404494:0:14270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffffa05ad1a219c0 10000000:01000000:3.0:1784938278.404500:0:14270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938278.404510:0:14270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffffa05ad1a219c0 from 1 10000000:01000000:3.0:1784938278.404514:0:14270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1784938278.404984:0:14270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.404998:0:14270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.405012:0:14270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938278.405041:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540096:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938278.405109:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.405210:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938278.405448:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540096 00000100:00100000:0.0:1784938278.405458:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540096 00000100:00100000:0.0:1784938278.405548:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1784938278.405559:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+5:14270:x1871643065540096:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938278.405577:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938278.405597:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0031200/0xea86628a8aec4714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec470d expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.405638:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0031200/0xea86628a8aec4714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec470d expref: 6 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.405650:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0031200/0xea86628a8aec4714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec470d expref: 6 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.405661:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031200, rc 0) 00000100:00100000:0.0:1784938278.405832:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+6:14270:x1871643065540096:12345-0@lo:101:mount.lustre.0 Request processed in 273us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938278.405839:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938278.405904:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540096:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938278.405919:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.405929:0:14270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938278.405997:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540224:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938278.406029:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.406198:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.406978:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540224 00000100:00100000:2.0:1784938278.406986:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540224 00000100:00100000:2.0:1784938278.407022:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1784938278.407031:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+6:14270:x1871643065540224:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.409158:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+6:14270:x1871643065540224:12345-0@lo:501:mount.lustre.0 Request processed in 2116us (3118us total) trans 0 rc -2/-2 00000100:00100000:2.0:1784938278.409184:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1784938278.409577:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540224:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1784938278.409635:0:14270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1784938278.409660:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.409672:0:14270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938278.409697:0:14270:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa05aff9ff000 10000000:01000000:3.0:1784938278.409703:0:14270:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1784938278.409708:0:14270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffffa05aff9ff000 10000000:01000000:3.0:1784938278.409711:0:14270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1784938278.409715:0:14270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffffa05aff9ff000 from 1 10000000:01000000:3.0:1784938278.409717:0:14270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1784938278.409759:0:14270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.409768:0:14270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.409780:0:14270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938278.409816:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540352:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938278.409860:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.409895:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.410013:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540352 00000100:00100000:2.0:1784938278.410027:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540352 00000100:00100000:2.0:1784938278.410065:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1784938278.410074:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+6:14270:x1871643065540352:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938278.410098:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938278.410119:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893a00/0xea86628a8aec4722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec471b expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.410145:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893a00/0xea86628a8aec4722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec471b expref: 7 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.410156:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893a00/0xea86628a8aec4722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec471b expref: 7 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.410326:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893a00, rc 0) 00000100:00100000:2.0:1784938278.410358:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+7:14270:x1871643065540352:12345-0@lo:101:mount.lustre.0 Request processed in 285us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.410365:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1784938278.410590:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540352:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938278.410607:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4722 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.410616:0:14270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4722 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938278.410636:0:14270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1784938278.410653:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4722 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.410668:0:14270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d400/0xea86628a8aec471b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4722 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938278.410674:0:14270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1784938278.410678:0:14270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1784938278.410684:0:14270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffffa05aff9ff000 10000000:01000000:3.0:1784938278.410686:0:14270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1784938278.410690:0:14270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1784938278.410692:0:14270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1784938278.410711:0:14270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.410718:0:14270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.410725:0:14270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938278.410735:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540480:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938278.410765:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.410797:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938278.410926:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540480 00000100:00100000:0.0:1784938278.410931:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540480 00000100:00100000:0.0:1784938278.410972:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938278.410979:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+7:14270:x1871643065540480:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938278.410990:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938278.411001:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0031a00/0xea86628a8aec4730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4729 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.411017:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0031a00/0xea86628a8aec4730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4729 expref: 8 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.411026:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0031a00/0xea86628a8aec4730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4729 expref: 8 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.411040:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0031a00, rc 0) 00000100:00100000:0.0:1784938278.411099:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+8:14270:x1871643065540480:12345-0@lo:101:mount.lustre.0 Request processed in 120us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938278.411105:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1784938278.411302:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540480:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938278.411315:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4730 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.411323:0:14270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4730 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938278.411375:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540608:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938278.411402:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938278.411432:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34273c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938278.411495:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540608 00000100:00100000:3.0:1784938278.411500:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540608 00000100:00100000:3.0:1784938278.411533:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938278.411540:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+8:14270:x1871643065540608:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938278.412494:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14270:x1871643065540608:12345-0@lo:501:mount.lustre.0 Request processed in 950us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938278.412519:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1784938278.412756:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540608:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.415352:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1087b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938278.415480:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.415613:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada325a80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938278.415686:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540736 00000100:00100000:1.0:1784938278.415697:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540736 00000100:00100000:1.0:1784938278.415906:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1784938278.415917:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14270:x1871643065540736:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938278.416455:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14270:x1871643065540736:12345-0@lo:503:mount.lustre.0 Request processed in 538us (974us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.416465:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1784938278.416686:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1087b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065540736:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938278.417477:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1087b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14306:1871643065540864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.417547:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.423190:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada325300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938278.423410:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065540864 00000100:00100000:3.0:1784938278.423426:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065540864 00000100:00100000:3.0:1784938278.423514:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1784938278.423528:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14306:x1871643065540864:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.429212:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14306:x1871643065540864:12345-0@lo:502:llog_process_th.0 Request processed in 5673us (11650us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.429256:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1784938278.433931:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1087b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14306:1871643065540864:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1784938278.434019:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938278.434041:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.434044:0:14306:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784938278.434052:0:14306:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1784938278.434057:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938278.436264:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffffa05ac6b20000) 00000020:00000080:0.0:1784938278.436312:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1784938278.436340:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1784938278.436479:0:14306:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1784938278.436495:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec473e 00000020:00000080:0.0:1784938278.438128:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1784938278.438142:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938278.438149:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.438151:0:14306:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1784938278.438155:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938278.438163:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.438353:0:14306:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1784938278.438362:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938278.438381:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffffa05ac6b24d40) 00000020:00000080:0.0:1784938278.438406:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1784938278.438410:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1784938278.438413:0:14306:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1784938278.438416:0:14306:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1784938278.438424:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1784938278.438528:0:14306:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05aff9ff000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1784938278.438549:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffffa05ac6b219c0) 00000020:00000080:0.0:1784938278.438559:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1784938278.439776:0:14306:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1784938278.439796:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec4753 00000020:00000080:0.0:1784938278.447296:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1784938278.447322:0:14306:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1784938278.447338:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xea86628a8aec475a 00080000:01000000:0.0:1784938278.447350:0:14306:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1784938278.447355:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec4761 00010000:00010000:1.0:1784938278.665118:0:14306:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1784938278.665928:0:14306:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:1.0:1784938278.666168:0:14306:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1784938278.667171:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffffa05ae1774d40) 00000020:00000080:1.0:1784938278.667197:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1784938278.667332:0:14306:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1784938278.667346:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec476f 00000020:00000080:3.0:1784938278.668194:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1784938278.684748:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xea86628a8aec4776 00000020:00000080:0.0:1784938278.685693:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1784938278.685708:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938278.685715:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.685717:0:14306:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1784938278.685721:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1784938278.685723:0:14306:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1784938278.685725:0:14306:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938278.685727:0:14306:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1784938278.685729:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1784938278.685731:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.685733:0:14306:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1784938278.685736:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938278.685741:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.685743:0:14306:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1784938278.685747:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1784938278.685792:0:14306:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1784938278.685807:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938278.685810:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.685811:0:14306:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1784938278.685813:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1784938278.685817:0:14306:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1784938278.685821:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938278.685832:0:14306:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1784938278.685836:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1784938278.686077:0:14306:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:0.0:1784938278.686119:0:14306:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1784938278.686123:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1784938278.686142:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffffa05ac6b23380) 00000020:00000080:0.0:1784938278.686162:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1784938278.686167:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1784938278.686275:0:14306:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1784938278.686282:0:14306:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:0.0:1784938278.686289:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec4784 00010000:00080000:0.0:1784938278.686332:0:14306:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05af52ad800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1784938278.694402:0:14306:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:0.0:1784938278.697701:0:14306:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1784938278.697756:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1784938278.699642:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1784938278.699742:0:14306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1784938278.699826:0:14306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1784938278.700904:0:14310:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784938278.700911:0:14310:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1784938278.705880:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1784938278.705901:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1784938278.705951:0:14306:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1784938278.705976:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec478b 00000100:00080000:1.0:1784938278.705992:0:14306:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:1.0:1784938278.706006:0:14306:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa05af52ad800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784938278.706059:0:14306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c3549c00 x1871643065540992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938278.706097:0:14306:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:2.0:1784938278.706263:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065540992:192.168.201.158@tcp:8:llog_process_th.0 00000020:01000000:1.0:1784938278.706691:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1784938278.706697:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938278.706699:0:14306:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1784938278.706702:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1784938278.706705:0:14306:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1784938278.706707:0:14306:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938278.706708:0:14306:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1784938278.706710:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1784938278.706712:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938278.706714:0:14306:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1784938278.706717:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1784938278.706721:0:14306:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1784938278.706724:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1784938278.706725:0:14306:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1784938278.706728:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1784938278.706732:0:14306:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1784938278.706750:0:14306:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1784938278.706765:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1784938278.706776:0:14306:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffffa05ae1770000) 00000020:00000080:1.0:1784938278.706789:0:14306:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1784938278.706794:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1784938278.706858:0:14306:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1784938278.706865:0:14306:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1784938278.706871:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xea86628a8aec4799 00010000:00080000:1.0:1784938278.706923:0:14306:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05af410a800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784938278.707164:0:14306:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1784938278.707412:0:14306:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1784938278.707439:0:14306:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1784938278.708141:0:14306:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938278.708263:0:14306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1784938278.708337:0:14306:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000400:00000100:0.0:1784938278.708641:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 28 match 1871643065540992 offset 0 length 520: 4 00000040:00080000:0.0:1784938278.709424:0:14312:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1784938278.709431:0:14312:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1784938278.710989:0:14306:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1784938278.711005:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1784938278.711041:0:14306:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1784938278.711062:0:14306:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec47a0 00000100:00080000:2.0:1784938278.711077:0:14306:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:2.0:1784938278.711101:0:14306:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa05af410a800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:2.0:1784938278.711144:0:14306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c1087100 x1871643065541120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1784938278.711260:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065541120:192.168.201.158@tcp:8:llog_process_th.0 00000400:00000100:3.0:1784938278.711594:0:3316:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 28 match 1871643065541120 offset 0 length 520: 4 00000100:00080000:2.0:1784938278.711928:0:14306:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1784938278.712003:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938278.712008:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.712010:0:14306:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1784938278.712013:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938278.712017:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.712019:0:14306:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938278.712022:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938278.712023:0:14306:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784938278.712026:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938278.712028:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.712029:0:14306:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784938278.712031:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938278.712033:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.712035:0:14306:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784938278.712039:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1784938278.712072:0:14306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14306:1871643065541248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.712143:0:14306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.712179:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065541248 00000100:00100000:2.0:1784938278.712186:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065541248 00000100:00100000:2.0:1784938278.712261:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938278.712280:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14306:x1871643065541248:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.712797:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14306:x1871643065541248:12345-0@lo:502:llog_process_th.0 Request processed in 517us (652us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.712806:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1784938278.712861:0:14306:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac6860d80 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.712883:0:14306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14306:1871643065541248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938278.712911:0:14306:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938278.712917:0:14306:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.712919:0:14306:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784938278.712924:0:14306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1784938278.713143:0:14270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1784938278.713166:0:14270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1784938278.713186:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4730 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.713199:0:14270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87ca00/0xea86628a8aec4729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4730 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938278.713207:0:14270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05aff9ff000 from 1 10000000:01000000:1.0:1784938278.713211:0:14270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1784938278.713274:0:14270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.713284:0:14270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.713293:0:14270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938278.713317:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541376:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938278.713350:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938278.713373:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac3427180 going to sleep for 11 seconds 00000100:00100000:3.0:1784938278.713431:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065541376 00000100:00100000:3.0:1784938278.713438:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065541376 00000100:00100000:3.0:1784938278.713481:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1784938278.713488:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+9:14270:x1871643065541376:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938278.713500:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938278.713515:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec47a7 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.713540:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 10 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.713562:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 10 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.713571:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87cc00, rc 0) 00000100:00100000:3.0:1784938278.713602:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+10:14270:x1871643065541376:12345-0@lo:101:mount.lustre.0 Request processed in 115us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938278.713609:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1784938278.713784:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541376:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938278.713797:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.713807:0:14270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938278.714381:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541504:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1784938278.714422:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938278.714443:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac3427180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938278.714475:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065541504 00000100:00100000:1.0:1784938278.714480:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065541504 00000100:00100000:1.0:1784938278.714509:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1784938278.714516:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+10:14270:x1871643065541504:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1784938278.714533:0:14280:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1784938278.714538:0:14280:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1784938278.714936:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+10:14270:x1871643065541504:12345-0@lo:256:mount.lustre.0 Request processed in 418us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.714943:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1784938278.719897:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541504:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1784938278.721211:0:14270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1784938278.721263:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.721279:0:14270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938278.721289:0:14270:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05aff9ff000 from 1 10000000:01000000:2.0:1784938278.721292:0:14270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1784938278.721349:0:14270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.721359:0:14270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.721369:0:14270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938278.721411:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541632:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938278.721688:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.721736:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938278.721802:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065541632 00000100:00100000:0.0:1784938278.721810:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065541632 00000100:00100000:0.0:1784938278.721895:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1784938278.721905:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+10:14270:x1871643065541632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938278.721920:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938278.721944:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec47b5 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.721969:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.721980:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.721990:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030000, rc 0) 00000100:00100000:0.0:1784938278.722042:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065541632:12345-0@lo:101:mount.lustre.0 Request processed in 139us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938278.722050:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1784938278.722125:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541632:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938278.722140:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.722149:0:14270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938278.722199:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.722246:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.723358:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86f00 going to sleep for 11 seconds 00000100:00100000:1.0:1784938278.723855:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065541760 00000100:00100000:1.0:1784938278.723865:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065541760 00000100:00100000:1.0:1784938278.723912:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1784938278.723924:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065541760:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938278.724543:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065541760:12345-0@lo:501:mount.lustre.0 Request processed in 621us (2294us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.724618:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1784938278.724769:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.724817:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938278.724864:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.724897:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86f00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938278.724959:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065541888 00000100:00100000:0.0:1784938278.724966:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065541888 00000100:00100000:0.0:1784938278.724997:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1784938278.725004:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065541888:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1784938278.725172:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065541888:12345-0@lo:503:mount.lustre.0 Request processed in 168us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938278.725179:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1784938278.725331:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065541888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938278.725764:0:14314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14314:1871643065542016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.725804:0:14314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.725828:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542016 00000100:00100000:2.0:1784938278.725832:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542016 00000100:00100000:2.0:1784938278.725853:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938278.725859:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14314:x1871643065542016:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.726055:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14314:x1871643065542016:12345-0@lo:502:llog_process_th.0 Request processed in 195us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.726062:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1784938278.726113:0:14314:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.726125:0:14314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14314:1871643065542016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938278.726147:0:14314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938278.726156:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.726158:0:14314:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1784938278.726166:0:14314:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05aff9ff000 00000020:00000080:2.0:1784938278.726168:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784938278.726175:0:14314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938278.726178:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.726179:0:14314:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1784938278.726181:0:14314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938278.726184:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.726185:0:14314:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1784938278.726188:0:14314:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05aff9ff000 00000020:00000080:2.0:1784938278.726190:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1784938278.726261:0:14314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938278.726265:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.726266:0:14314:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1784938278.726268:0:14314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938278.726270:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.726272:0:14314:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1784938278.726275:0:14314:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa05aff9ff000 00000020:00000080:2.0:1784938278.726277:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1784938278.726306:0:14314:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14314:1871643065542144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.726338:0:14314:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.726358:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542144 00000100:00100000:2.0:1784938278.726362:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542144 00000100:00100000:2.0:1784938278.726386:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938278.726392:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14314:x1871643065542144:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1784938278.726515:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14314:x1871643065542144:12345-0@lo:502:llog_process_th.0 Request processed in 122us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.726522:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1784938278.726560:0:14314:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe863c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.726572:0:14314:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14314:1871643065542144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1784938278.726590:0:14314:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938278.726594:0:14314:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938278.726596:0:14314:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1784938278.726599:0:14314:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1784938278.726662:0:14270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1784938278.726683:0:14270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1784938278.726699:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.726709:0:14270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938278.726749:0:14270:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1784938278.726752:0:14270:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa05aff9ff000 10000000:01000000:2.0:1784938278.726755:0:14270:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa05aff9ff000 10000000:01000000:2.0:1784938278.726759:0:14270:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1784938278.726764:0:14270:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05aff9ff000 from 1 10000000:01000000:2.0:1784938278.726767:0:14270:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1784938278.726789:0:14270:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.726798:0:14270:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.726813:0:14270:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938278.726825:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065542272:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1784938278.726851:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.726864:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.726883:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542272 00000100:00100000:2.0:1784938278.726887:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542272 00000100:00100000:2.0:1784938278.726904:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938278.726910:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065542272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938278.726917:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938278.726929:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893400/0xea86628a8aec47ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec47c3 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.726950:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893400/0xea86628a8aec47ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec47c3 expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.726960:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893400/0xea86628a8aec47ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47c3 expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.726969:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893400, rc 0) 00000100:00100000:2.0:1784938278.726998:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14270:x1871643065542272:12345-0@lo:101:mount.lustre.0 Request processed in 88us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.727004:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1784938278.727033:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065542272:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938278.727045:0:14270:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ca expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.727060:0:14270:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec47ca expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938278.727112:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065542400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.727138:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.727150:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.727162:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542400 00000100:00100000:2.0:1784938278.727166:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542400 00000100:00100000:2.0:1784938278.727181:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784938278.727186:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14270:x1871643065542400:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.727457:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14270:x1871643065542400:12345-0@lo:501:mount.lustre.0 Request processed in 269us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.727464:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1784938278.727498:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065542400:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938278.727527:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065542528:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938278.730059:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.730122:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe86c00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.730161:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542528 00000100:00100000:2.0:1784938278.730171:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542528 00000100:00100000:2.0:1784938278.730235:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1784938278.730245:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14270:x1871643065542528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938278.733212:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14270:x1871643065542528:12345-0@lo:503:mount.lustre.0 Request processed in 2948us (3140us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.733246:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1784938278.737195:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065542528:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938278.739544:0:14318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14318:1871643065542656:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938278.739635:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.739682:0:14318:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5e40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938278.739754:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542656 00000100:00100000:0.0:1784938278.739763:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542656 00000100:00100000:0.0:1784938278.739812:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1784938278.739822:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14318:x1871643065542656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1784938278.740124:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14318:x1871643065542656:12345-0@lo:502:llog_process_th.0 Request processed in 302us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938278.740143:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1784938278.740617:0:14318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14318:1871643065542656:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1784938278.740682:0:14318:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1784938278.740698:0:14318:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffffa05ad094cd40) 00000020:00000080:3.0:1784938278.740718:0:14318:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1784938278.740895:0:14318:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05aff9ff000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938278.740900:0:14318:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05aff9ff000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1784938278.740903:0:14318:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05aff9ff000 4 00010000:00080000:3.0:1784938278.740934:0:14318:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05ae1722800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1784938278.756014:0:14318:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1784938278.756195:0:14318:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1784938278.756274:0:14318:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1784938278.756296:0:14318:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xea86628a8aec47d8 00000100:00080000:3.0:1784938278.756317:0:14318:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:3.0:1784938278.756334:0:14318:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa05ae1722800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:3.0:1784938278.756398:0:14318:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05b01ddc380 x1871643065542784/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938278.756448:0:14318:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1784938278.757643:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065542784:192.168.201.158@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938278.757993:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938278.758163:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542784 00000100:00100000:0.0:1784938278.758172:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542784 00000100:00100000:0.0:1784938278.758238:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:0.0:1784938278.758246:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3320:x1871643065542784:12345-192.168.201.158@tcp:38:llog_process_th.0 00000100:00100000:0.0:1784938278.758315:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3320:x1871643065542784:12345-192.168.201.158@tcp:38:llog_process_th.0 Request processed in 66us (322us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938278.758323:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938278.759844:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938278.759861:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05ae1722800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938278.759869:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.201.158@tcp failed (-11) 00000100:00100000:1.0:1784938278.759874:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065542784:192.168.201.158@tcp:38:llog_process_th.0 00000100:00100000:3.0:1784938278.763372:0:14318:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14318:1871643065542912:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1784938278.767175:0:14318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.767275:0:14318:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a5e40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938278.768201:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065542912 00000100:00100000:1.0:1784938278.768230:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065542912 00000100:00100000:1.0:1784938278.768281:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784938278.768289:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14318:x1871643065542912:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1784938278.768572:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14318:x1871643065542912:12345-0@lo:502:llog_process_th.0 Request processed in 283us (1406us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.768580:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1784938278.768661:0:14318:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14318:1871643065542912:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1784938278.768697:0:14318:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1784938278.772867:0:14270:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784938278.772903:0:14270:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938278.776591:0:14270:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ca expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938278.776611:0:14270:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05afc892c00/0xea86628a8aec47c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ca expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938278.776675:0:14270:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938278.776677:0:14270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938278.776679:0:14270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938278.776680:0:14270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938278.776682:0:14270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938278.776683:0:14270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938278.776684:0:14270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938278.776686:0:14270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938278.776688:0:14270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938278.776689:0:14270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938278.776693:0:14270:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1784938278.776696:0:14270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938278.776697:0:14270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1784938278.776698:0:14270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938278.776699:0:14270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938278.776704:0:14270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938278.776705:0:14270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938278.776706:0:14270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1784938278.776707:0:14270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1784938278.776708:0:14270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938278.776709:0:14270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938278.776745:0:14270:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1784938278.776767:0:14270:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065543040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938278.776843:0:14270:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938278.776893:0:14270:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5d3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938278.777121:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543040 00000100:00100000:2.0:1784938278.777132:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543040 00000100:00100000:2.0:1784938278.777242:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784938278.777253:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14270:x1871643065543040:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938278.777293:0:14280:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1784938278.777310:0:14280:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1784938278.822704:0:14280:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1784938278.822728:0:14280:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1784938278.822783:0:14304:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1784938278.822788:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1784938278.822814:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.822836:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 12 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.822866:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.822918:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 12 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938278.822933:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 12 pid: 14282 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938278.822948:0:14304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14304:1871643065543168:0@lo:104: 00000100:00100000:3.0:1784938278.823026:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938278.823087:0:14304:0:(client.c:2702:ptlrpc_set_wait()) set ffffa059c20a53c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938278.823266:0:14271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543168 00000100:00100000:1.0:1784938278.823275:0:14271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543168 00000100:00100000:1.0:1784938278.823325:0:14271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1784938278.823334:0:14271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14304:x1871643065543168:12345-0@lo:104: 00010000:00010000:1.0:1784938278.823349:0:14271:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938278.823492:0:14304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddfb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14304:1871643065543168:0@lo:104: 00010000:00010000:3.0:1784938278.823510:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.824582:0:14271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938278.824595:0:14271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14304:x1871643065543168:12345-0@lo:104: Request processed in 1259us (1566us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938278.824606:0:14271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1784938278.824670:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938278.824680:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.824690:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990a00 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938278.824695:0:14277:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.824708:0:14277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938278.824718:0:14277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938278.824724:0:14277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1784938278.824780:0:14277:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.824789:0:14277:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938278.824820:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.824828:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec47a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47ae expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.824864:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.824866:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938278.824868:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938278.824999:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938278.825017:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065543296:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938278.825104:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938278.825384:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543296 00000100:00100000:2.0:1784938278.825390:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543296 00010000:00010000:2.0:1784938278.825415:0:14273:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 13 pid: 14282 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938278.825451:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1784938278.825557:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+13:3324:x1871643065543296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938278.825571:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938278.825576:0:14273:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 13 pid: 14282 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825589:0:14273:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 13 pid: 14282 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825603:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05aff87cc00/0xea86628a8aec47ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec47a7 expref: 13 pid: 14282 timeout: 587 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825617:0:14273:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825626:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1784938278.825642:0:14273:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002854713s 00010000:00010000:2.0:1784938278.825646:0:14273:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825664:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825672:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825679:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825685:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938278.825690:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.825698:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.826064:0:14304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938278.826075:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.826118:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.826127:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05aff87c200/0xea86628a8aec47df lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938278.826147:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938278.827444:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3324:x1871643065543296:12345-0@lo:103:ldlm_bl.0 Request processed in 1977us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938278.827524:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1784938278.828648:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065543296:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938278.833052:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14270:x1871643065543040:12345-0@lo:253:mount.lustre.0 Request processed in 55789us (56197us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938278.833073:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1784938278.834349:0:14270:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14270:1871643065543040:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784938278.834370:0:14270:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1784938278.834373:0:14270:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938278.834392:0:14270:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1784938278.834393:0:14270:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938278.834395:0:14270:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938278.834396:0:14270:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938278.834397:0:14270:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938278.834399:0:14270:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1784938278.834400:0:14270:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1784938278.834402:0:14270:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938278.834403:0:14270:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938278.834419:0:14270:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1784938278.842623:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938278.842801:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938278.843344:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938278.843589:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938278.843853:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938278.844103:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938278.846641:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938278.846842:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938278.847400:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1784938278.847723:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1784938278.848072:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938278.848635:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1784938278.876965:0:14270:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1784938278.879839:0:14270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1784938278.879935:0:14327:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1784938278.879939:0:14327:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1784938278.880325:0:14328:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1784938278.880443:0:14328:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938278.884622:0:14328:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1784938278.884711:0:14328:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1784938278.884716:0:14328:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1784938278.888727:0:14270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1784938278.888909:0:14270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1784938278.892573:0:14270:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1784938278.892610:0:14270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1784938278.892962:0:14270:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938278.894001:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1784938278.894613:0:14270:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1784938278.894647:0:14270:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1784938278.897838:0:14270:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1784938278.904615:0:14270:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1784938278.962573:0:14270:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1784938278.962607:0:14270:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb7b301cc7988 00100000:10000000:3.0:1784938278.962614:0:14270:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1784938278.963140:0:14270:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938278.963157:0:14270:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938278.963177:0:14270:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1784938278.963197:0:14270:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1784938279.089410:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938279.795373:0:14285:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1784938279.795381:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05aff9ff000 from 6 10000000:01000000:3.0:1784938279.795388:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1784938279.795452:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938279.795465:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938279.795476:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938279.795503:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065543424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938279.795572:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938279.795644:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada3d1840 going to sleep for 11 seconds 00000040:00080000:0.0:1784938279.796426:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1784938279.797289:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543424 00000100:00100000:0.0:1784938279.797299:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543424 00000100:00100000:0.0:1784938279.797353:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938279.797363:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14285:x1871643065543424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938279.797382:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938279.797402:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec47e6 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938279.797430:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 12 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938279.797441:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 12 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938279.797449:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030400, rc 0) 00000100:00100000:0.0:1784938279.797516:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14285:x1871643065543424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1944us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938279.797539:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1784938279.797597:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065543424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938279.797615:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938279.797624:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938279.798656:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065543552:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1784938279.798748:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938279.798773:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938279.798794:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543552 00000100:00100000:0.0:1784938279.798799:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543552 00000100:00100000:0.0:1784938279.798829:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938279.798835:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14285:x1871643065543552:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784938279.798855:0:14280:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784938279.798869:0:14280:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784938279.798872:0:14280:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1784938279.799056:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14285:x1871643065543552:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 219us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938279.799074:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1784938279.799119:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065543552:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1784938279.799164:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1784938279.799173:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938279.799193:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938280.118591:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938280.818494:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1784938281.137583:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938282.161318:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938283.185535:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938284.083596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938284.083615:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938284.083619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1784938284.083622:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1784938284.083625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1784938284.083630:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1784938284.083634:0:8:0:(import.c:65:import_set_state_nolock()) ffffa05ae1722800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1784938284.083654:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffffa05ae1722800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:2.0:1784938284.083685:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c1086300 x1871643065543808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938284.083755:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065543680:0@lo:400:kworker.0 00000100:00100000:2.0:1784938284.083846:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938284.083995:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543680 00000100:00100000:0.0:1784938284.084003:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543680 00000100:00100000:0.0:1784938284.084047:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938284.084056:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3324:x1871643065543680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938284.084121:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3324:x1871643065543680:12345-0@lo:400:kworker.0 Request processed in 66us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938284.084128:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1784938284.084162:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065543808:192.168.201.158@tcp:38:kworker.0 00000100:00100000:0.0:1784938284.084402:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938284.084439:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065543680:0@lo:400:kworker.0 00000100:00100000:2.0:1784938284.084679:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543808 00000100:00100000:2.0:1784938284.084684:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543808 00000100:00100000:2.0:1784938284.084702:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784938284.084707:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1871643065543808:12345-192.168.201.158@tcp:38:kworker.0 00010000:00080000:2.0:1784938284.084728:0:14290:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 493 last 0 00000020:00000080:2.0:1784938284.084762:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xea86628a8aec47f4 00000004:00100000:2.0:1784938284.084774:0:14290:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938284.084919:0:14290:0:(import.c:65:import_set_state_nolock()) ffffa059c34f7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938284.084959:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3320:x1871643065543808:12345-192.168.201.158@tcp:38:kworker.0 Request processed in 251us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938284.084966:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:3.0:1784938284.086523:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa059c1086300 x1871643065543808/t0(0) o38->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1784938284.086553:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1784938284.086566:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1784938284.086574:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1784938284.086599:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05ae1722800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1784938284.086609:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3320:1871643065543808:192.168.201.158@tcp:38:kworker.0 00010000:00010000:2.0:1784938284.218999:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1784938284.299000:0:14569:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1784938285.233475:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938286.263566:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938287.287441:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938288.177647:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938278/real 1784938278] req@ffffa059c1087100 x1871643065541120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938288.177689:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa059c1087100 x1871643065541120/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938288.177700:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938278/real 1784938278] req@ffffa059c3549c00 x1871643065540992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938288 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938288.177712:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa059c3549c00 x1871643065540992/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938288 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1784938288.177736:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938288.177769:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.158@tcp failed (-110) 00000100:00100000:2.0:1784938288.177776:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1087100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065541120:192.168.201.158@tcp:8:llog_process_th.0 00000100:00080000:2.0:1784938288.177782:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af52ad800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1784938288.177788:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.158@tcp failed (-110) 00000100:00100000:2.0:1784938288.177792:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3549c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065540992:192.168.201.158@tcp:8:llog_process_th.0 00000100:00100000:1.0:1784938288.178012:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3321:1871643065543936:0@lo:400:kworker.0 00000100:00100000:1.0:1784938288.178100:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938288.178204:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065543936 00000100:00100000:2.0:1784938288.178234:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065543936 00000100:00100000:2.0:1784938288.178292:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784938288.178302:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3321:x1871643065543936:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1784938288.178394:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938288.178400:0:11402:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784938288.178403:0:11402:0:(import.c:65:import_set_state_nolock()) ffffa05af52ad800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938288.178410:0:11402:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 487 00000100:00080000:3.0:1784938288.178418:0:11402:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938288.178425:0:11402:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa05af52ad800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:3.0:1784938288.178457:0:11402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05b01dde300 x1871643065544064/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938288.178473:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938288.178476:0:11402:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938288.178477:0:11402:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938288.178481:0:11402:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 487 00000100:00080000:3.0:1784938288.178484:0:11402:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1784938288.178487:0:11402:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa05af410a800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:3.0:1784938288.178498:0:11402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05b01ddf100 x1871643065544192/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1784938288.182522:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3321:x1871643065543936:12345-0@lo:400:kworker.0 Request processed in 4206us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938288.182540:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1784938288.182646:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065544064:192.168.201.158@tcp:8:kworker.0 00000100:00100000:2.0:1784938288.182749:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065544192:192.168.201.158@tcp:8:kworker.0 00000400:00000100:2.0:1784938288.182967:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 28 match 1871643065544064 offset 0 length 520: 4 00000400:00000100:2.0:1784938288.183063:0:3315:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-192.168.201.158@tcp portal 28 match 1871643065544192 offset 0 length 520: 4 00000100:00100000:1.0:1784938288.188316:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dde680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3321:1871643065543936:0@lo:400:kworker.0 00000100:00100000:1.0:1784938288.188369:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938288.188388:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065544320:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938288.188854:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938288.188900:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065544320 00000100:00100000:2.0:1784938288.188908:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065544320 00000100:00100000:2.0:1784938288.188979:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938288.188990:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065544320:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938288.189065:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065544320:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938288.189074:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00010000:00080000:2.0:1784938288.189247:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa05b01ddc700 x1871643065544320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938304 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938288.189262:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065544320:192.168.201.158@tcp:400:kworker.0 00000020:00000080:1.0:1784938288.251714:0:14721:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2bcf6f30 20000000:00000080:1.0:1784938288.251747:0:14721:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa05afcdc1800 uarg=0000000000000000 20000000:01000000:1.0:1784938288.251811:0:14721:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1784938288.251822:0:14721:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1784938288.251831:0:14721:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1784938288.265615:0:14722:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1784938288.269005:0:14721:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1784938288.284147:0:14721:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1784938288.285185:0:14721:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938288.285244:0:14721:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938288.285255:0:14721:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938288.285348:0:14721:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 11 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938288.285368:0:14721:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 11 pid: 14283 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938288.285391:0:14721:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14721:1871643065544448:0@lo:104: 00000100:00100000:3.0:1784938288.285518:0:14721:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938288.285594:0:14721:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad89a1d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938288.286773:0:14271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065544448 00000100:00100000:1.0:1784938288.286789:0:14271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065544448 00000100:00100000:1.0:1784938288.286876:0:14271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938288.286909:0:14271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14721:x1871643065544448:12345-0@lo:104: 00010000:00010000:1.0:1784938288.286944:0:14271:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.287078:0:14271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1784938288.287085:0:14271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14721:x1871643065544448:12345-0@lo:104: Request processed in 181us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938288.287094:0:14271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1784938288.287556:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938288.287570:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938288.287581:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:2.0:1784938288.287588:0:14277:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938288.287612:0:14277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1784938288.287621:0:14277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1784938288.287629:0:14277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1784938288.287734:0:14277:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938288.287742:0:14277:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1784938288.287776:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938288.287784:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05afc893000/0xea86628a8aec47b5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47bc expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938288.287810:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938288.287812:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938288.287814:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938288.287826:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1784938288.287847:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065544576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938288.290268:0:14721:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14721:1871643065544448:0@lo:104: 00010000:00010000:3.0:1784938288.290323:0:14721:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938288.294380:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938288.294520:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065544576 00000100:00100000:1.0:1784938288.294540:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065544576 00010000:00010000:1.0:1784938288.294609:0:14274:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 12 pid: 14283 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938288.294677:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1784938288.294691:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3324:x1871643065544576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938288.294721:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938288.294728:0:14274:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 12 pid: 14283 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294749:0:14274:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 12 pid: 14283 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294778:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030000/0xea86628a8aec47bc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec47b5 expref: 12 pid: 14283 timeout: 597 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294810:0:14274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294820:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294865:0:14274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294873:0:14274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294881:0:14274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294890:0:14274:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294900:0:14274:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938288.294906:0:14274:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294941:0:14274:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294961:0:14274:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938288.294972:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1784938288.295024:0:14721:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938288.295041:0:14721:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938288.295051:0:14721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05aff87c600/0xea86628a8aec47fb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14721 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938288.295082:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1085180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:3324:x1871643065544576:12345-0@lo:103:ldlm_bl.0 Request processed in 392us (711us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938288.295092:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1784938288.297720:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065544576:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938288.305585:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938289.329511:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1784938289.457297:0:14285:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1784938289.457310:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05aff9ff000 from 10 10000000:01000000:3.0:1784938289.457318:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938289.457665:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938289.457681:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938289.457702:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938289.457737:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065544704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1784938289.458560:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938289.458744:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31eeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1784938289.458950:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065544704 00000100:00100000:0.0:1784938289.458962:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065544704 00000100:00100000:0.0:1784938289.459042:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1784938289.459053:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+11:14285:x1871643065544704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938289.459073:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938289.459099:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4802 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938289.459134:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4802 expref: 12 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938289.459167:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4802 expref: 12 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938289.459181:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030200, rc 0) 00000100:00100000:3.0:1784938289.459711:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065544704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938289.459735:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938289.459746:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938289.459850:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065544832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938289.459893:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938289.459945:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac31eeb40 going to sleep for 11 seconds 00000100:00100000:3.0:1784938289.460700:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065544832 00000100:00100000:3.0:1784938289.460711:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065544832 00000100:00100000:3.0:1784938289.460770:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1784938289.460782:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+13:14285:x1871643065544832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1784938289.467062:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+13:14285:x1871643065544832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 6017us (6902us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938289.467083:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1784938289.469794:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065544832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938289.469892:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065544960:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938289.470024:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938289.470100:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa553c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938289.470357:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14285:x1871643065544704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 11301us (11796us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938289.470371:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1784938289.473905:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065544960 00000100:00100000:2.0:1784938289.473932:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065544960 00000100:00100000:2.0:1784938289.474011:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1784938289.474025:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14285:x1871643065544960:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938289.474556:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14285:x1871643065544960:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 532us (4530us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938289.474566:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1784938289.474618:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065544960:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938289.478796:0:14760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784938289.488995:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784938289.489065:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938289.489086:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938289.489105:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1784938290.051942:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1784938290.363427:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938291.381170:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938292.401599:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938293.259706:0:14922:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938293.259714:0:14922:0:(obd_mount.c:922:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1784938293.260054:0:14922:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa05afb438000 00000020:01000004:3.0:1784938293.260090:0:14922:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784938293.260112:0:14922:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1784938293.260139:0:14922:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffffa05ad094b380) 00000020:00000080:3.0:1784938293.260169:0:14922:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00000100:00080000:1.0:1784938293.300496:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938293.300520:0:11402:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938293.300525:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938293.300547:0:11402:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1784938293.300630:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065545216:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938293.301395:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065545088:0@lo:400:kworker.0 00000100:00100000:3.0:1784938293.301476:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938293.301559:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545088 00000100:00100000:3.0:1784938293.301584:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545088 00000100:00100000:3.0:1784938293.301650:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784938293.301661:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3324:x1871643065545088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1784938293.301726:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:3324:x1871643065545088:12345-0@lo:400:kworker.0 Request processed in 66us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.301733:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1784938293.302198:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3549f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065545088:0@lo:400:kworker.0 00000100:00100000:1.0:1784938293.304106:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938293.304254:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545216 00000100:00100000:0.0:1784938293.304266:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545216 00000100:00100000:0.0:1784938293.304351:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:0.0:1784938293.304371:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065545216:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938293.304464:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065545216:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 104us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938293.304473:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:1.0:1784938293.309262:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa059c354ad80 x1871643065545216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938309 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938293.310148:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065545216:192.168.201.158@tcp:400:kworker.0 00100000:10000000:1.0:1784938293.332521:0:14922:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1784938293.333479:0:14922:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1784938293.337189:0:14922:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1784938293.337529:0:14922:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1784938293.339393:0:14922:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1784938293.341169:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 409: rc = 0 00100000:10000000:1.0:1784938293.341350:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 409: rc = 0 00100000:10000000:1.0:1784938293.341467:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 409: rc = 0 00100000:10000000:1.0:1784938293.343553:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 648: rc = 0 00100000:10000000:1.0:1784938293.344424:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 648: rc = 0 00100000:10000000:1.0:1784938293.345276:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 648: rc = 0 00100000:10000000:1.0:1784938293.346187:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 648: rc = 0 00100000:10000000:1.0:1784938293.346537:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 648: rc = 0 00100000:10000000:1.0:1784938293.350902:0:14922:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 648: rc = 0 00000020:00000080:2.0:1784938293.353614:0:14922:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1784938293.353636:0:14922:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1784938293.353657:0:14922:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea86628a8aec4817 00000020:01000004:2.0:1784938293.353673:0:14922:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1784938293.353719:0:14922:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1784938293.353726:0:14922:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1784938293.353736:0:14922:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1784938293.353753:0:14922:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1784938293.353772:0:14922:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffffa05ad1a24d40) 00000020:00000080:2.0:1784938293.353787:0:14922:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1784938293.356125:0:14922:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938293.356442:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938293.356449:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1784938293.362795:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1784938293.362825:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1784938293.371542:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1784938293.372309:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1784938293.386560:0:14922:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938293.386799:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1784938293.386809:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1784938293.394156:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1784938293.394171:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00010000:00010000:2.0:1784938293.429430:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938293.467274:0:14922:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1784938293.467527:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1784938293.467542:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1784938293.470245:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1784938293.470262:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1784938293.476122:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1784938293.476155:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1784938293.483599:0:14922:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938293.484085:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1784938293.484093:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1784938293.496905:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1784938293.496934:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1784938293.610068:0:14922:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1784938293.610385:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1784938293.610393:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1784938293.613069:0:14922:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1784938293.613085:0:14922:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1784938293.614543:0:14922:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1784938293.614572:0:14922:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1784938293.614579:0:14922:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1784938293.636762:0:14922:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1784938293.636821:0:14922:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1784938293.637170:0:14922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1784938293.637172:0:14922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938293.637174:0:14922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938293.637175:0:14922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938293.637176:0:14922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938293.637177:0:14922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938293.637179:0:14922:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938293.637182:0:14922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938293.637184:0:14922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938293.637190:0:14922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1784938293.637192:0:14922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938293.637194:0:14922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938293.637196:0:14922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938293.637197:0:14922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938293.637198:0:14922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938293.637199:0:14922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938293.637200:0:14922:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938293.637202:0:14922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938293.637203:0:14922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1784938293.637796:0:14922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784938293.637905:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545344:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938293.638018:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938293.638153:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63540 going to sleep for 11 seconds 00000100:00100000:1.0:1784938293.638959:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545344 00000100:00100000:1.0:1784938293.638975:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545344 00000100:00100000:1.0:1784938293.639125:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1784938293.639138:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14922:x1871643065545344:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1784938293.639249:0:14283:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1784938293.639253:0:14283:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1784938293.639259:0:14283:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1784938293.665945:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14922:x1871643065545344:12345-0@lo:253:mount.lustre.0 Request processed in 26799us (27916us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.665962:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1784938293.671814:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545344:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938293.671861:0:14922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784938293.671864:0:14922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938293.671866:0:14922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938293.671867:0:14922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938293.671869:0:14922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938293.671870:0:14922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938293.671871:0:14922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938293.671873:0:14922:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938293.671875:0:14922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938293.671876:0:14922:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1784938293.671903:0:14922:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa05afb438000 from lustre-OST0000 10000000:01000000:0.0:1784938293.672200:0:14922:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1784938293.672235:0:14922:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1784938293.672242:0:14922:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa05ad1a219c0 local copy 00010000:00010000:0.0:1784938293.672255:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938293.672496:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938293.672553:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938293.672595:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.672660:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545472 00000100:00100000:3.0:1784938293.672667:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545472 00000100:00100000:3.0:1784938293.672715:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1784938293.672724:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14922:x1871643065545472:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938293.672889:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14922:x1871643065545472:12345-0@lo:501:mount.lustre.0 Request processed in 166us (335us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938293.672898:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1784938293.673102:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545472:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784938293.673116:0:14922:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784938293.673336:0:14922:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784938293.673346:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.673357:0:14922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938293.673383:0:14922:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa05afb438000 10000000:01000000:1.0:1784938293.673389:0:14922:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938293.673393:0:14922:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffffa05ad1a219c0 10000000:01000000:1.0:1784938293.673396:0:14922:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1784938293.673399:0:14922:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffffa05ad1a219c0 from 1 10000000:01000000:1.0:1784938293.673403:0:14922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1784938293.673433:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.673442:0:14922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.673452:0:14922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938293.673472:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545600:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938293.673504:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.673525:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938293.673621:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545600 00000100:00100000:2.0:1784938293.673627:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545600 00000100:00100000:2.0:1784938293.673670:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1784938293.673679:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+12:14922:x1871643065545600:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938293.673691:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938293.673709:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893c00/0xea86628a8aec482c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4825 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938293.673732:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893c00/0xea86628a8aec482c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4825 expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938293.673742:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893c00/0xea86628a8aec482c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4825 expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938293.673762:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893c00, rc 0) 00000100:00100000:2.0:1784938293.673801:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+13:14922:x1871643065545600:12345-0@lo:101:mount.lustre.0 Request processed in 124us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938293.673807:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1784938293.674365:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545600:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938293.674382:0:14922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec482c expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.674391:0:14922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec482c expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938293.674413:0:14922:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1784938293.674436:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec482c expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.674444:0:14922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8991000/0xea86628a8aec4825 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec482c expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938293.674452:0:14922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1784938293.674457:0:14922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938293.674462:0:14922:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1784938293.674465:0:14922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1784938293.674484:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.674491:0:14922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.674498:0:14922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938293.674523:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545728:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938293.674561:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.674586:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938293.674661:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545728 00000100:00100000:0.0:1784938293.674666:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545728 00000100:00100000:0.0:1784938293.674695:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1784938293.674702:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+13:14922:x1871643065545728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1784938293.674713:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938293.674724:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac0030600/0xea86628a8aec483a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4833 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.674740:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030600/0xea86628a8aec483a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4833 expref: 14 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.674749:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac0030600/0xea86628a8aec483a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4833 expref: 14 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.674756:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac0030600, rc 0) 00000100:00100000:0.0:1784938293.674796:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065545728:12345-0@lo:101:mount.lustre.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938293.674801:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1784938293.675325:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545728:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938293.675339:0:14922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec483a expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.675348:0:14922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec483a expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1784938293.676723:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1784938293.678756:0:14922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1784938293.679084:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1784938293.679132:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1784938293.679170:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1784938293.679241:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1784938293.679283:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1784938293.679348:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1784938293.679411:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1784938293.679418:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1784938293.679509:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545856:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938293.679585:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938293.679634:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7d33000 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.679853:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545856 00000100:00100000:3.0:1784938293.679861:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545856 00000100:00100000:3.0:1784938293.679917:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1784938293.679926:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065545856:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938293.680314:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065545856:12345-0@lo:501:mount.lustre.0 Request processed in 387us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.680322:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1784938293.680523:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545856:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938293.680561:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545984:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938293.680598:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.680629:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac34276c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.680686:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065545984 00000100:00100000:3.0:1784938293.680691:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065545984 00000100:00100000:3.0:1784938293.680722:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1784938293.680729:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065545984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938293.681235:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065545984:12345-0@lo:503:mount.lustre.0 Request processed in 483us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.681252:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1784938293.681611:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065545984:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938293.682448:0:14922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938293.682536:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546112:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.682607:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.682645:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546112 00000100:00100000:1.0:1784938293.682651:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546112 00000100:00100000:1.0:1784938293.682685:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784938293.682692:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065546112:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.682887:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065546112:12345-0@lo:502:mount.lustre.0 Request processed in 194us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.682904:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1784938293.682949:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada3d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938293.682966:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546112:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938293.683176:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784938293.683246:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784938293.683279:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784938293.683319:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784938293.683348:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784938293.683389:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784938293.683429:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784938293.683457:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784938293.683482:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1784938293.683518:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1784938293.683545:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1784938293.683583:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1784938293.683608:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546240:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.683646:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.683673:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546240 00000100:00100000:1.0:1784938293.683677:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546240 00000100:00100000:1.0:1784938293.683696:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784938293.683702:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065546240:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.683845:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065546240:12345-0@lo:502:mount.lustre.0 Request processed in 143us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.683852:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1784938293.683885:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada3d1840 going to sleep for 11 seconds 00000100:00100000:1.0:1784938293.683900:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546240:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938293.683956:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1784938293.683972:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1784938293.688775:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938293.688789:0:14936:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1784938293.688796:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.688799:0:14936:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1784938293.688806:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938293.688832:0:14936:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffffa05ad1a20000) 00000020:00000080:2.0:1784938293.688862:0:14936:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784938293.688869:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784938293.689001:0:14936:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05afb438000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1784938293.689010:0:14936:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938293.689018:0:14936:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xea86628a8aec4848 00010000:00010000:2.0:1784938293.695664:0:14936:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1784938293.697066:0:14936:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1784938293.708242:0:14936:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1784938293.717620:0:14936:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1784938293.717634:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938293.717641:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.717654:0:14936:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1784938293.717659:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1784938293.717661:0:14936:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #16 00000020:01000000:2.0:1784938293.717663:0:14936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938293.717664:0:14936:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1784938293.717666:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1784938293.717668:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.717670:0:14936:0:(obd_config.c:1561:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:2.0:1784938293.717672:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938293.717675:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.717676:0:14936:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1784938293.717679:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1784938293.717680:0:14936:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1784938293.717682:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938293.717698:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.717700:0:14936:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1784938293.717703:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1784938293.717705:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.717706:0:14936:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1784938293.717710:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1784938293.717797:0:14936:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1784938293.717801:0:14936:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938293.717803:0:14936:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1784938293.717806:0:14936:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1784938293.718013:0:14922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1784938293.718050:0:14922:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1784938293.718088:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec483a expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.718103:0:14922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8990800/0xea86628a8aec4833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec483a expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938293.718112:0:14922:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05afb438000 from 1 10000000:01000000:3.0:1784938293.718115:0:14922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938293.718158:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.718166:0:14922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.718178:0:14922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938293.718205:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546368:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938293.718306:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938293.718351:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05acb139cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938293.718456:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546368 00000100:00100000:1.0:1784938293.718465:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546368 00000100:00100000:1.0:1784938293.718527:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1784938293.718538:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+14:14922:x1871643065546368:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938293.718554:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938293.718571:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec484f expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.718598:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec484f expref: 15 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.718610:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec484f expref: 15 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.718619:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991c00, rc 0) 00000100:00100000:1.0:1784938293.718654:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546368:12345-0@lo:101:mount.lustre.0 Request processed in 118us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.718660:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1784938293.724348:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546368:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938293.724380:0:14922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.724393:0:14922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938293.725051:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784938293.725583:0:14922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938293.725853:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784938293.725899:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784938293.727773:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784938293.727793:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784938293.728480:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546496:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938293.728552:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938293.728657:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05acb139cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.736410:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546496 00000100:00100000:3.0:1784938293.736425:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546496 00000100:00100000:3.0:1784938293.736489:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1784938293.736499:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546496:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938293.736821:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546496:12345-0@lo:501:mount.lustre.0 Request processed in 323us (8267us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.736840:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1784938293.738619:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546496:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1784938293.738693:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1087480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546624:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938293.739554:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938293.739608:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7d33780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.744294:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546624 00000100:00100000:3.0:1784938293.744313:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546624 00000100:00100000:3.0:1784938293.744404:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1784938293.744415:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546624:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938293.744815:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546624:12345-0@lo:503:mount.lustre.0 Request processed in 400us (5264us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.744834:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1784938293.745045:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1087480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546624:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938293.753442:0:14922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938293.753580:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546752:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.753685:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.753749:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55540 going to sleep for 11 seconds 00000100:00100000:2.0:1784938293.753970:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546752 00000100:00100000:2.0:1784938293.753981:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546752 00000100:00100000:2.0:1784938293.754047:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1784938293.754058:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546752:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938293.754343:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546752:12345-0@lo:502:mount.lustre.0 Request processed in 285us (658us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938293.754351:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1784938293.754518:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546752:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938293.754864:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784938293.754919:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784938293.754983:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784938293.755038:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784938293.755067:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784938293.755109:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784938293.755139:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784938293.755165:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784938293.755194:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546880:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.757128:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.757179:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05affa55540 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.757312:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065546880 00000100:00100000:3.0:1784938293.757333:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065546880 00000100:00100000:3.0:1784938293.757403:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1784938293.757414:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546880:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938293.757651:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065546880:12345-0@lo:502:mount.lustre.0 Request processed in 239us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.757659:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1784938293.760820:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065546880:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938293.761089:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784938293.761125:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1784938293.766169:0:14940:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938293.766184:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938293.766187:0:14940:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1784938293.766195:0:14940:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05afb438000 00000020:00000080:3.0:1784938293.766198:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938293.766207:0:14940:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938293.766209:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938293.766211:0:14940:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1784938293.766254:0:14940:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938293.766257:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938293.766259:0:14940:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1784938293.766262:0:14940:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05afb438000 00000020:00000080:3.0:1784938293.766264:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938293.767180:0:14940:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938293.767187:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938293.767189:0:14940:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1784938293.767192:0:14940:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1784938293.767194:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938293.767196:0:14940:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1784938293.767199:0:14940:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa05afb438000 00000020:00000080:3.0:1784938293.767202:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1784938293.769253:0:14940:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1784938293.769266:0:14940:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1784938293.769268:0:14940:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1784938293.769273:0:14940:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1784938293.770942:0:14922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1784938293.770993:0:14922:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938293.771070:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.771085:0:14922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938293.771142:0:14922:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1784938293.771146:0:14922:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa05afb438000 10000000:01000000:0.0:1784938293.771149:0:14922:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa05afb438000 10000000:01000000:0.0:1784938293.771153:0:14922:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1784938293.771160:0:14922:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05afb438000 from 1 10000000:01000000:0.0:1784938293.771163:0:14922:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1784938293.771209:0:14922:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.771446:0:14922:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.771460:0:14922:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938293.771490:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547008:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1784938293.771574:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.787173:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547008 00000100:00100000:1.0:1784938293.787189:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547008 00000100:00100000:1.0:1784938293.787273:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784938293.787284:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065547008:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938293.787301:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938293.787321:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991800/0xea86628a8aec4864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec485d expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.787361:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991800/0xea86628a8aec4864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec485d expref: 16 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.787374:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991800/0xea86628a8aec4864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec485d expref: 16 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.787385:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991800, rc 0) 00000100:00100000:1.0:1784938293.787447:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547008:12345-0@lo:101:mount.lustre.0 Request processed in 165us (15873us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938293.787454:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1784938293.787519:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe63300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938293.787546:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547008:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938293.787565:0:14922:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4864 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938293.787585:0:14922:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4864 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938293.790893:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1784938293.791410:0:14922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938293.791719:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784938293.791769:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784938293.791804:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784938293.791863:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784938293.791902:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784938293.791950:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784938293.791988:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784938293.792022:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784938293.792102:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784938293.792138:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784938293.792168:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784938293.792251:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784938293.792288:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784938293.792316:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784938293.792356:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784938293.792386:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784938293.792414:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784938293.792468:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784938293.792506:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784938293.792537:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784938293.792580:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784938293.792612:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784938293.792642:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784938293.792686:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784938293.792735:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1784938293.792768:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1784938293.792837:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1784938293.792872:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1784938293.792943:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1784938293.792952:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1784938293.793055:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938293.793126:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.793169:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938293.793604:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547136 00000100:00100000:0.0:1784938293.793614:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547136 00000100:00100000:0.0:1784938293.793666:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1784938293.793676:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938293.793932:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547136:12345-0@lo:501:mount.lustre.0 Request processed in 257us (805us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938293.793941:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1784938293.800294:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547136:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938293.800369:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547264:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938293.800443:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.800482:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6300 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.800651:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547264 00000100:00100000:3.0:1784938293.800664:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547264 00000100:00100000:3.0:1784938293.800709:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1784938293.800717:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938293.800925:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547264:12345-0@lo:503:mount.lustre.0 Request processed in 208us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.800933:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1784938293.801342:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547264:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938293.801896:0:14922:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938293.801968:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547392:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.802022:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.802062:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6300 going to sleep for 11 seconds 00000100:00100000:2.0:1784938293.802274:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547392 00000100:00100000:2.0:1784938293.802282:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547392 00000100:00100000:2.0:1784938293.802319:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1784938293.802329:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547392:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938293.802556:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547392:12345-0@lo:502:mount.lustre.0 Request processed in 227us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938293.802564:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1784938293.802707:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547392:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938293.802997:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784938293.803051:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1784938293.803080:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1784938293.803123:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1784938293.803160:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1784938293.803207:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1784938293.804963:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1784938293.805018:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1784938293.805119:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784938293.805157:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1784938293.805203:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1784938293.805267:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1784938293.805297:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1784938293.805324:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1784938293.805372:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1784938293.805409:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1784938293.805444:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1784938293.805491:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1784938293.805527:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1784938293.805562:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1784938293.805605:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1784938293.805639:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1784938293.805670:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1784938293.805715:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1784938293.805773:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1784938293.805811:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1784938293.806297:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1784938293.806333:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1784938293.806362:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1784938293.806400:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1784938293.806428:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1784938293.806454:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1784938293.806486:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1784938293.806550:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1784938293.806590:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1784938293.806653:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1784938293.806694:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1784938293.806729:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1784938293.806780:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1784938293.806816:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1784938293.807140:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547520:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938293.807536:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938293.807612:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbbf6300 going to sleep for 11 seconds 00000100:00100000:0.0:1784938293.810908:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547520 00000100:00100000:0.0:1784938293.810923:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547520 00000100:00100000:0.0:1784938293.810980:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1784938293.810990:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547520:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938293.811300:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547520:12345-0@lo:502:mount.lustre.0 Request processed in 311us (3765us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938293.811309:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1784938293.811499:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547520:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938293.811631:0:14922:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1784938293.811646:0:14922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1784938293.812876:0:14945:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1784938293.812895:0:14945:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffffa05ae1773380) 00000020:00000080:1.0:1784938293.812920:0:14945:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1784938293.813122:0:14945:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05afb438000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784938293.813127:0:14945:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05afb438000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1784938293.813130:0:14945:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05afb438000 3 00010000:00080000:1.0:1784938293.813161:0:14945:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05aefb7e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784938293.814613:0:14945:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1784938293.814725:0:14945:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1784938293.814760:0:14945:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784938293.814776:0:14945:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xea86628a8aec4872 00000100:00080000:1.0:1784938293.814790:0:14945:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:1.0:1784938293.814803:0:14945:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffffa05aefb7e000 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784938293.814868:0:14945:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c354a300 x1871643065547648/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938293.814931:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1871643065547648:192.168.201.158@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938293.815269:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00080000:1.0:1784938293.815299:0:14945:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938293.815326:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938293.815330:0:11402:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1784938293.815333:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938293.815336:0:11402:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1784938293.816516:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547648 00000100:00100000:2.0:1784938293.816528:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547648 00000100:00100000:2.0:1784938293.816572:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:2.0:1784938293.816581:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1871643065547648:12345-192.168.201.158@tcp:38:llog_process_th.0 00010000:00080000:2.0:1784938293.816613:0:14290:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:2.0:1784938293.816653:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xea86628a8aec4879 00000004:00100000:2.0:1784938293.816666:0:14290:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1784938293.816701:0:14290:0:(import.c:65:import_set_state_nolock()) ffffa05ac6db0000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938293.816762:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3320:x1871643065547648:12345-192.168.201.158@tcp:38:llog_process_th.0 Request processed in 182us (1494us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938293.816770:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00010000:00080000:2.0:1784938293.816984:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffffa059c354a300 x1871643065547648/t0(0) o38->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938293.816996:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1784938293.817003:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1784938293.817010:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1784938293.817015:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1784938293.817017:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05aefb7e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1784938293.817022:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3320:1871643065547648:192.168.201.158@tcp:38:llog_process_th.0 00000040:00080000:1.0:1784938293.822265:0:14945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1784938293.822717:0:14922:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1784938293.822747:0:14922:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1784938293.822765:0:14922:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4864 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.822778:0:14922:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0030000/0xea86628a8aec485d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4864 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1784938293.822842:0:14922:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1784938293.822845:0:14922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938293.822846:0:14922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938293.822848:0:14922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938293.822849:0:14922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938293.822851:0:14922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938293.822852:0:14922:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938293.822854:0:14922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938293.822856:0:14922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938293.822862:0:14922:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1784938293.822865:0:14922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1784938293.822866:0:14922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938293.822867:0:14922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938293.822872:0:14922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938293.822873:0:14922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938293.822874:0:14922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938293.822875:0:14922:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938293.822876:0:14922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938293.822877:0:14922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1784938293.822924:0:14922:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1784938293.822951:0:14922:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1784938293.823045:0:14922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938293.823092:0:14922:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be60c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.824139:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547776 00000100:00100000:3.0:1784938293.824151:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547776 00000100:00100000:3.0:1784938293.824210:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1784938293.824235:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14922:x1871643065547776:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1784938293.824267:0:14282:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1784938293.824282:0:14282:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1784938293.900991:0:14282:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1784938293.901017:0:14282:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1784938293.901108:0:14304:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1784938293.901114:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1784938293.901140:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.901158:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 16 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.901166:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.901206:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 16 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938293.901250:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 16 pid: 14282 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938293.901267:0:14304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14304:1871643065547904:0@lo:104: 00000100:00100000:0.0:1784938293.901353:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938293.901403:0:14304:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6840 going to sleep for 11 seconds 00000100:00100000:3.0:1784938293.901604:0:14271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065547904 00000100:00100000:3.0:1784938293.901611:0:14271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065547904 00000100:00100000:3.0:1784938293.901664:0:14271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938293.901673:0:14271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14304:x1871643065547904:12345-0@lo:104: 00010000:00010000:3.0:1784938293.901687:0:14271:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.901741:0:14271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938293.901748:0:14271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14304:x1871643065547904:12345-0@lo:104: Request processed in 76us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.901754:0:14271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1784938293.901774:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938293.901780:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.901805:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d000 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938293.901809:0:14276:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.901817:0:14276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938293.901835:0:14276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938293.901842:0:14276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1784938293.901870:0:14276:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.901878:0:14276:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938293.901897:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.901916:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87d000/0xea86628a8aec47e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec47ed expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.901935:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938293.901937:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938293.901939:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938293.901955:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065548032:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1784938293.901986:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938293.902031:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548032 00000100:00100000:3.0:1784938293.902035:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548032 00010000:00010000:3.0:1784938293.902055:0:14275:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 17 pid: 14282 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938293.902088:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938293.902095:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:3322:x1871643065548032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938293.902108:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938293.902114:0:14275:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 17 pid: 14282 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902126:0:14275:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 17 pid: 14282 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902143:0:14275:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902151:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1784938293.902166:0:14275:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002854713s 00010000:00010000:3.0:1784938293.902170:0:14275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902179:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902187:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902194:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902201:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938293.902252:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902263:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902272:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902284:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938293.902314:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:3322:x1871643065548032:12345-0@lo:103:ldlm_bl.0 Request processed in 220us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.902320:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1784938293.902596:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065548032:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1784938293.902629:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030400/0xea86628a8aec47ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec47e6 expref: 16 pid: 14282 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938293.902640:0:14304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14304:1871643065547904:0@lo:104: 00010000:00010000:3.0:1784938293.902654:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902663:0:14304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902669:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938293.902675:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030800/0xea86628a8aec4880 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938293.929816:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14922:x1871643065547776:12345-0@lo:253:mount.lustre.0 Request processed in 105569us (106757us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938293.929843:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1784938293.929988:0:14922:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14922:1871643065547776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1784938293.930005:0:14922:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1784938293.930024:0:14922:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1784938293.930026:0:14922:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1784938293.930027:0:14922:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1784938293.930028:0:14922:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1784938293.930030:0:14922:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1784938293.930031:0:14922:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1784938293.930032:0:14922:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1784938293.930034:0:14922:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1784938293.930036:0:14922:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1784938293.930050:0:14922:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1784938293.937601:0:14922:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938293.937772:0:14922:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938293.938016:0:14922:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938293.938169:0:14922:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938293.938411:0:14922:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938293.938635:0:14922:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1784938293.939629:0:14922:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784938294.004953:0:14922:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1784938294.004965:0:14922:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1784938294.005011:0:14922:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1784938294.005654:0:14922:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1784938294.005688:0:14922:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1784938294.005720:0:14922:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1784938294.452498:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938295.479323:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784938295.857561:0:14285:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938295.857577:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05aff9ff000 from 7 10000000:01000000:0.0:1784938295.857586:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938295.857660:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938295.857676:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938295.857689:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938295.857731:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065548160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938295.857841:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938295.857965:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938295.860971:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548160 00000100:00100000:1.0:1784938295.860988:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548160 00000100:00100000:1.0:1784938295.861085:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1784938295.861096:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+15:14285:x1871643065548160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938295.861117:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938295.861140:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4887 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938295.861171:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4887 expref: 16 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938295.861195:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4887 expref: 16 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938295.861207:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990e00, rc 0) 00000100:00100000:1.0:1784938295.861329:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14285:x1871643065548160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (3489us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938295.861337:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1784938295.861476:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065548160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1784938295.861499:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938295.861521:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938295.861598:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065548288:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1784938295.861638:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938295.861933:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac7d333c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938295.862067:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548288 00000100:00100000:0.0:1784938295.862075:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548288 00000100:00100000:0.0:1784938295.862109:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1784938295.862117:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14285:x1871643065548288:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1784938295.862138:0:14280:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1784938295.862164:0:14280:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1784938295.862168:0:14280:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1784938295.862443:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14285:x1871643065548288:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 325us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938295.862450:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1784938295.862694:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065548288:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938295.862754:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938295.862763:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938295.862773:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938296.504527:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938297.527818:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938298.545400:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1784938298.932455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938298.932465:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1784938298.932469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1784938298.932473:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1784938298.932665:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065548544:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.932714:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3323:1871643065548416:0@lo:400:kworker.0 00000100:00100000:3.0:1784938298.932842:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065548672:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.934715:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938298.934986:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938298.935578:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548544 00000100:00100000:3.0:1784938298.935592:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548544 00000100:00100000:3.0:1784938298.935707:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548672 00000100:00100000:3.0:1784938298.935711:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548672 00000100:00100000:1.0:1784938298.935848:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938298.935862:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065548544:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.935947:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3549f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065548544:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 88us (1245us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938298.935955:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:1.0:1784938298.935977:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:1.0:1784938298.936012:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065548672:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938298.936050:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3549c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065548672:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 49us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938298.936057:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00080000:1.0:1784938298.936094:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1784938298.936673:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05affeb5f80 x1871643065548544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938298.936695:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065548544:192.168.201.158@tcp:400:kworker.0 00010000:00080000:1.0:1784938298.936816:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05affeb6d80 x1871643065548672/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938298.936827:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065548672:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938298.938421:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938298.938515:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548416 00000100:00100000:0.0:1784938298.938525:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548416 00000100:00100000:0.0:1784938298.941416:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784938298.941449:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3323:x1871643065548416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938298.941601:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3323:x1871643065548416:12345-0@lo:400:kworker.0 Request processed in 168us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938298.941612:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1784938298.941721:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3323:1871643065548416:0@lo:400:kworker.0 00010000:00010000:0.0:1784938299.570850:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1784938300.278782:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1784938300.593444:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938301.617988:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1784938301.874108:0:15288:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1784938302.646749:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938303.025379:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938288/real 1784938288] req@ffffa05b01dde300 x1871643065544064/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938303.025426:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa05b01dde300 x1871643065544064/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938303.025438:0:3320:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1784938288/real 1784938288] req@ffffa05b01ddf100 x1871643065544192/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938303 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938303.025451:0:3320:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffffa05b01ddf100 x1871643065544192/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 1 dl 1784938303 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1784938303.025479:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af52ad800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938303.026355:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.201.158@tcp failed (-110) 00000100:00100000:1.0:1784938303.026362:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065544064:192.168.201.158@tcp:8:kworker.0 00000100:00080000:1.0:1784938303.026372:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938303.028762:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.158@tcp failed (-110) 00000100:00100000:1.0:1784938303.028778:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065544192:192.168.201.158@tcp:8:kworker.0 00000100:00080000:3.0:1784938303.030431:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938303.030446:0:11402:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1784938303.030451:0:11402:0:(import.c:65:import_set_state_nolock()) ffffa05af52ad800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938303.030465:0:11402:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 497 00000100:00080000:3.0:1784938303.030479:0:11402:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784938303.030488:0:11402:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffffa05af52ad800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:3.0:1784938303.030540:0:11402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05b01ddce00 x1871643065548928/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1784938303.030568:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1784938303.030571:0:11402:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1784938303.030573:0:11402:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1784938303.030578:0:11402:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 497 00000100:00080000:3.0:1784938303.030581:0:11402:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1784938303.030584:0:11402:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa05af410a800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:3.0:1784938303.030598:0:11402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa05b01ddf100 x1871643065549056/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938303.030732:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938303.030832:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3321:1871643065548800:0@lo:400:kworker.0 00000100:00100000:1.0:1784938303.030931:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938303.031013:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548800 00000100:00100000:1.0:1784938303.031023:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548800 00000100:00100000:1.0:1784938303.031080:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1784938303.031092:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3321:x1871643065548800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938303.031160:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3321:x1871643065548800:12345-0@lo:400:kworker.0 Request processed in 69us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.031169:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1784938303.031891:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065549312:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938303.031982:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938303.031990:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065549184:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938303.032948:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3321:1871643065548800:0@lo:400:kworker.0 00000100:00100000:0.0:1784938303.033557:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065548928:192.168.201.158@tcp:8:kworker.0 00000100:00100000:0.0:1784938303.033698:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065549056:192.168.201.158@tcp:8:kworker.0 00000100:00100000:0.0:1784938303.033864:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938303.039398:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549312 00000100:00100000:1.0:1784938303.039424:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549312 00000100:00080000:2.0:1784938303.039507:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938303.039568:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:1.0:1784938303.039585:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065549312:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938303.048116:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938303.048149:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938303.048174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938303.048354:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065548928 00000100:00100000:2.0:1784938303.048367:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065548928 00000100:00100000:2.0:1784938303.048409:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549056 00000100:00100000:2.0:1784938303.048411:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549056 00000100:00100000:2.0:1784938303.048428:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938303.048438:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3320:x1871643065548928:12345-192.168.201.158@tcp:8:kworker.0 00010000:00080000:2.0:1784938303.048493:0:14925:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 511 last 0 00000020:00000080:2.0:1784938303.048541:0:14925:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec4895 00002000:00100000:2.0:1784938303.048559:0:14925:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffffa05af4efa000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1784938303.048564:0:14925:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1784938303.048568:0:14925:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1784938303.048765:0:14289:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938303.048776:0:14289:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1784938303.048990:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549184 00000100:00100000:3.0:1784938303.048996:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549184 00000100:00100000:3.0:1784938303.049038:0:14289:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938303.049047:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00002000:00080000:2.0:1784938303.049048:0:14925:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1784938303.049055:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065549184:12345-192.168.201.158@tcp:400:kworker.0 00000100:00080000:2.0:1784938303.049090:0:14925:0:(import.c:65:import_set_state_nolock()) ffffa05af4ef9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938303.049290:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065549312:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 9707us (15425us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.049303:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:3.0:1784938303.049567:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065549184:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 512us (1463us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938303.049575:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00010000:00080000:1.0:1784938303.055141:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05b01dde300 x1871643065549184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938303.055180:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065549184:192.168.201.158@tcp:400:kworker.0 00010000:00080000:1.0:1784938303.055200:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05b01ddd180 x1871643065549312/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938303.055211:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065549312:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938303.057409:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3320:x1871643065548928:12345-192.168.201.158@tcp:8:kworker.0 Request processed in 8957us (9244us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938303.057427:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938303.057481:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784938303.057491:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3320:x1871643065549056:12345-192.168.201.158@tcp:8:kworker.0 00010000:00020000:2.0:1784938303.057521:0:14925:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.201.158@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1784938303.057580:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3320:x1871643065549056:12345-192.168.201.158@tcp:8:kworker.0 Request processed in 90us (9405us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938303.057587:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00010000:00080000:0.0:1784938303.058045:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa05b01ddce00 x1871643065548928/t0(0) o8->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938323 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938303.058058:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1784938303.058069:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784938303.058080:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938303.058088:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1784938303.058093:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af52ad800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938303.058118:0:3320:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938303.058126:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065548928:192.168.201.158@tcp:8:kworker.0 00000100:00080000:0.0:1784938303.058143:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1784938303.058147:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.158@tcp failed (-19) 00000100:00100000:0.0:1784938303.058151:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065549056:192.168.201.158@tcp:8:kworker.0 00000004:00080000:0.0:1784938303.058193:0:14310:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938303.058836:0:14310:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 512001619553ns, next at 0ns, rc = 0 00000004:00080000:1.0:1784938303.059312:0:14311:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:1.0:1784938303.059353:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14311:1871643065549568:192.168.201.158@tcp:5:osp-pre-0-0.0 00000100:00100000:1.0:1784938303.059447:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938303.059467:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938303.059479:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065549440:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938303.062899:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938303.062956:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549568 00000100:00100000:0.0:1784938303.062967:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549568 00000100:00100000:0.0:1784938303.063047:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:0.0:1784938303.063061:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14311:x1871643065549568:12345-192.168.201.158@tcp:5:osp-pre-0-0.0 00000100:00080000:2.0:1784938303.065860:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938303.075163:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938303.075267:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549440 00000100:00100000:1.0:1784938303.075281:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549440 00000100:00100000:1.0:1784938303.075356:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938303.075369:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871643065549440:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938303.075422:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938303.075510:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3548a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1871643065549440:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 143us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.075519:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00010000:00080000:0.0:1784938303.076081:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa059c354bb80 x1871643065549440/t0(0) o13->lustre-OST0000-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938303.076108:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065549440:192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00080000:0.0:1784938303.077271:0:14924:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1784938303.077283:0:14924:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1784938303.077291:0:14924:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1784938303.104205:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.104247:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.104271:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.104283:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.104291:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.104313:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.104326:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.104334:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.104367:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938303.104992:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.105000:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105012:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.105015:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.105019:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105029:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105038:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105051:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105071:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938303.105088:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938303.105096:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105104:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.105109:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105120:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105141:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105149:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec489c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105170:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.105174:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105193:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.105196:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105204:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105237:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105244:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec48a3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105257:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.105259:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.105260:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.105720:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.105727:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105737:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.105741:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.105745:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105756:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105771:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105779:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105798:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.105809:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.105813:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105819:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.105823:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105831:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105842:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105849:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.105862:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.105869:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.105871:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.106314:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.106320:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106329:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.106332:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.106337:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106347:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106356:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106362:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106379:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.106387:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.106391:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106398:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990c00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.106402:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106421:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106433:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106441:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48b1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.106455:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.106457:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.106459:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.116080:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.116102:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116127:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.116133:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.116142:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116160:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116172:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116189:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116255:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.116275:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.116282:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116290:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.116296:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116305:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116326:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116334:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.116360:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.116361:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.116363:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938303.123166:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.128618:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.128653:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128691:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.128697:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.128707:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128725:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128738:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128746:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128772:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.128790:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.128798:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128808:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.128814:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128826:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128864:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128874:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.128895:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.128897:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.128899:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.129473:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.129481:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.129492:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.129495:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.129501:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.129510:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.129519:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.129526:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.129555:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938303.133383:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938303.133405:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.133422:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938303.133429:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.133442:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.133482:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.133490:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec48c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.133528:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938303.133530:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938303.133532:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.145416:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.145436:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.145461:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.145466:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.145475:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.145493:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.145506:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.145515:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.145549:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938303.146099:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.146107:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146117:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.146128:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.146132:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146143:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146152:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146160:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146189:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1784938303.146211:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1784938303.146242:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146252:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.146258:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146271:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146294:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.146299:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.146315:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec48cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146346:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.146348:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.146351:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.146835:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.146842:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146852:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.146857:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.146862:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146873:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146882:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146890:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.146918:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938303.147169:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938303.147176:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.147196:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938303.147202:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.147211:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.147250:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.147259:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec48db lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938303.147280:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938303.147282:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938303.147284:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.147355:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.147366:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.147375:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.147379:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.147383:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.147393:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.147402:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.147409:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.147431:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938303.149237:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938303.149251:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149266:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.149272:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149283:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149310:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149341:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec48e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149374:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149382:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.149385:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149393:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149404:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149411:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec48d4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.149426:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.149428:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.149431:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.149436:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.149438:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.149439:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938303.151161:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.152054:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.152069:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152828:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.152837:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.152847:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152865:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152885:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152894:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152916:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.152932:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.152938:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152947:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.152953:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152963:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152983:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.152992:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec48e9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.153010:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.153019:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.153021:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.155083:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.156926:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.156951:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.156956:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.156964:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.156983:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.156997:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.157005:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.157044:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.158207:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.158272:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.158286:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990c00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.158291:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.158320:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.158344:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.158352:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adf02c8e/0xea86628a8aec48f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.158376:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.158378:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.158380:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.158988:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.158997:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159012:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.159017:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.159023:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159036:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159048:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159064:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159270:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.159290:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.159295:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159305:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.159309:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159318:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159332:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159340:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a72683a2/0xea86628a8aec48f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.159357:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.159359:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.159360:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.164526:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.164556:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.164579:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.164585:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.164593:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.164612:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.164625:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166242:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166307:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.166350:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.166359:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166369:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.166375:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166388:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166432:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166443:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac88486d/0xea86628a8aec48fe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.166480:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.166483:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.166486:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.171080:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.171105:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171130:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.171136:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.171147:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171165:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171177:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171186:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171262:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.171284:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.171292:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171301:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.171307:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171318:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171341:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171349:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4905 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.171372:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.171375:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.171377:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.172815:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.172834:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172855:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.172872:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.172878:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172894:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172906:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172915:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172946:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.172964:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.172973:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172982:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.172988:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.172998:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173017:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173040:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec490c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173066:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.173068:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.173070:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.173570:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.173576:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173586:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.173589:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.173593:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173603:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173613:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173620:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173642:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.173653:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.173677:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173685:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.173689:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173698:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173715:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173723:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec4913 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.173739:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.173740:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.173742:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.174176:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.174183:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174192:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.174196:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.174200:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174252:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174261:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174268:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174287:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.174298:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.174303:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174311:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.174315:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174323:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174333:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174341:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec491a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.174363:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.174365:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.174366:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.187260:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.187284:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187312:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.187318:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.187327:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187350:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187365:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187374:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187412:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.187445:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.187454:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187492:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.187499:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187510:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187533:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187541:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec4921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.187565:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.187566:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.187568:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.188393:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.188402:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188417:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.188422:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.188428:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188441:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188459:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188468:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188489:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938303.188505:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938303.188514:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188523:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938303.188529:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188539:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188556:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188565:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e0daf2e/0xea86628a8aec4928 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.188587:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.188595:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938303.188597:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.193916:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.193942:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.193964:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.193970:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.193977:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.193992:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.194005:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.194015:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.194042:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938303.195345:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.195359:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.195376:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.195380:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.195385:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.195407:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.195420:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.195428:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.195452:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1784938303.195784:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938303.195802:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195812:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.195818:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195828:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195852:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195863:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec9c8ce0/0xea86628a8aec492f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195894:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938303.195899:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195906:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.195909:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195918:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195943:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195951:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edab4ecf/0xea86628a8aec4936 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.195972:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.195975:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.195978:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938303.202744:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.202770:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.202798:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.202805:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.202814:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.202835:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.202849:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.202885:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.202919:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938303.203672:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.203680:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.203693:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.203698:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.203703:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.203713:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.203724:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.203731:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.203748:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1784938303.204159:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.204166:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204181:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.204185:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.204189:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204199:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204208:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204251:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204261:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1784938303.204700:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.204706:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204715:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.204718:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.204722:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204731:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204754:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204761:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.204770:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1784938303.205185:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938303.205192:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.205201:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=512s v=(0 0) 00010000:00010000:1.0:1784938303.205205:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938303.205210:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.205258:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.205266:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.205273:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938303.205294:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00080000:1.0:1784938303.205464:0:14924:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1784938303.205600:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14311:x1871643065549568:12345-192.168.201.158@tcp:5:osp-pre-0-0.0 Request processed in 142534us (142705us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938303.205618:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00010000:00010000:3.0:1784938303.205818:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1784938303.205830:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205840:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.205845:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205857:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205881:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205890:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3e1f505/0xea86628a8aec493d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205928:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938303.205932:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205938:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.205942:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205948:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205958:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205966:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000075a3fab/0xea86628a8aec4944 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205979:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938303.205983:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.205989:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.205992:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206012:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206022:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206028:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000719d0889/0xea86628a8aec494b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206042:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938303.206046:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206053:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.206056:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206064:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206074:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206082:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007ae9085/0xea86628a8aec4952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206106:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938303.206110:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206118:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938303.206121:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206129:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206140:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206148:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4959 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938303.206161:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.206162:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938303.206164:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938303.207171:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938303.207593:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1784938303.209396:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938303.209934:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14311:1871643065549568:192.168.201.158@tcp:5:osp-pre-0-0.0 00000004:00080000:1.0:1784938303.209958:0:14311:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:1.0:1784938303.210024:0:14311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14311:1871643065549696:192.168.201.158@tcp:5:osp-pre-0-0.0 00000100:00100000:1.0:1784938303.210126:0:14311:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac5104300 going to sleep for 11 seconds 00000100:00100000:1.0:1784938303.210289:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938303.210569:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549696 00000100:00100000:2.0:1784938303.210578:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549696 00000100:00100000:2.0:1784938303.210672:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:2.0:1784938303.210686:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14311:x1871643065549696:12345-192.168.201.158@tcp:5:osp-pre-0-0.0 00002000:00080000:2.0:1784938303.210759:0:14925:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1784938303.225692:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3549500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14311:x1871643065549696:12345-192.168.201.158@tcp:5:osp-pre-0-0.0 Request processed in 14990us (15385us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1784938303.225711:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:1.0:1784938303.228910:0:14311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14311:1871643065549696:192.168.201.158@tcp:5:osp-pre-0-0.0 00000004:00080000:1.0:1784938303.228941:0:14311:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1784938303.667178:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784938304.675998:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1784938304.676019:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1784938304.693650:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938305.713373:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938306.741940:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938307.764090:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938308.145549:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065549824:0@lo:400:kworker.0 00000100:00100000:2.0:1784938308.145737:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938308.145955:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549824 00000100:00100000:3.0:1784938308.145966:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549824 00000100:00100000:3.0:1784938308.146027:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938308.146038:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3322:x1871643065549824:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1784938308.146133:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938308.146140:0:11402:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784938308.146145:0:11402:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938308.146156:0:11402:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 511 00000100:00080000:1.0:1784938308.146165:0:11402:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1784938308.146172:0:11402:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa05af410a800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784938308.146202:0:11402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c3548700 x1871643065550080/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938308.146439:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065550336:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.148776:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3322:x1871643065549824:12345-0@lo:400:kworker.0 Request processed in 2725us (3025us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.148802:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1784938308.152562:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065550080:192.168.201.158@tcp:8:kworker.0 00000100:00100000:2.0:1784938308.152836:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065549824:0@lo:400:kworker.0 00000100:00100000:3.0:1784938308.153598:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065550208:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.153653:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938308.154968:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065549952:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938308.157259:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938308.157976:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550336 00000100:00100000:3.0:1784938308.157991:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550336 00000100:00100000:1.0:1784938308.158692:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938308.158737:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938308.158753:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065550464:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938308.159103:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550208 00000100:00100000:3.0:1784938308.159111:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550208 00000100:00100000:3.0:1784938308.159155:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:3.0:1784938308.160126:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065550336:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.160279:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065550336:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 1109us (3030us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.160304:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:2.0:1784938308.160625:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938308.160741:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938308.160807:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550080 00000100:00100000:2.0:1784938308.160817:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550080 00000100:00100000:2.0:1784938308.160856:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065549952 00000100:00100000:2.0:1784938308.160859:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065549952 00000100:00100000:2.0:1784938308.160896:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938308.160906:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065549952:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938308.160949:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065549952:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 45us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938308.160957:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:2.0:1784938308.160978:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:2.0:1784938308.160995:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065550080:12345-192.168.201.158@tcp:8:kworker.0 00010000:00080000:1.0:1784938308.161545:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa059c354b480 x1871643065550336/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938308.161570:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065550336:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.161742:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:3.0:1784938308.161755:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065550208:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.161800:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3549180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065550208:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 50us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938308.161807:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00080000:3.0:1784938308.161947:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1784938308.161955:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00020000:2.0:1784938308.163300:0:14924:0:(ldlm_lib.c:1215:target_handle_connect()) lustre-OST0001: not available for connect from 192.168.201.158@tcp (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1784938308.167799:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938308.168091:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550464 00000100:00100000:1.0:1784938308.168105:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550464 00000100:00100000:1.0:1784938308.168651:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:1.0:1784938308.168921:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065550464:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938308.168978:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938308.169964:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dded80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065550464:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 1043us (2172us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938308.169977:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:3.0:1784938308.172489:0:3324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1784938308.172563:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3549880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065549952:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938308.172625:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa059c354b800 x1871643065550208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938324 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938308.172639:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065550208:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938308.172707:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065550464:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938308.218752:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1086a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065550080:12345-192.168.201.158@tcp:8:kworker.0 Request processed in 57740us (58113us total) trans 0 rc -19/-19 00000100:00100000:2.0:1784938308.218773:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00080000:3.0:1784938308.222017:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1784938308.222039:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.158@tcp failed (-19) 00000100:00100000:3.0:1784938308.222046:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065550080:192.168.201.158@tcp:8:kworker.0 00010000:00010000:0.0:1784938308.785749:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1784938309.353980:0:15593:0:(obd_mount.c:919:lmd_print()) mount data: 00000020:01000004:3.0:1784938309.353985:0:15593:0:(obd_mount.c:922:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1784938309.354145:0:15593:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffffa05afc8a4000 00000020:01000004:3.0:1784938309.354164:0:15593:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1784938309.354177:0:15593:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1784938309.354191:0:15593:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffffa05ad0948000) 00000020:00000080:3.0:1784938309.354209:0:15593:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1784938309.373075:0:15593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1784938309.373657:0:15593:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1784938309.374404:0:15593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1784938309.374673:0:15593:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1784938309.374880:0:15593:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1784938309.376079:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 569: rc = 0 00100000:10000000:3.0:1784938309.376310:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 569: rc = 0 00100000:10000000:3.0:1784938309.376407:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 569: rc = 0 00100000:10000000:3.0:1784938309.376848:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 774: rc = 0 00100000:10000000:3.0:1784938309.377211:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 774: rc = 0 00100000:10000000:3.0:1784938309.377864:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 774: rc = 0 00100000:10000000:3.0:1784938309.378126:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 774: rc = 0 00100000:10000000:3.0:1784938309.378406:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 774: rc = 0 00100000:10000000:3.0:1784938309.378680:0:15593:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 774: rc = 0 00000020:00000080:3.0:1784938309.380680:0:15593:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1784938309.380697:0:15593:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1784938309.380710:0:15593:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea86628a8aec4967 00000020:01000004:3.0:1784938309.380720:0:15593:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1784938309.380754:0:15593:0:(obd_mount.c:406:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1784938309.380759:0:15593:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1784938309.380766:0:15593:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1784938309.380793:0:15593:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1784938309.380798:0:15593:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1784938309.397250:0:15593:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:1.0:1784938309.397299:0:15593:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.158@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1784938309.397305:0:15593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1784938309.397307:0:15593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938309.397309:0:15593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938309.397310:0:15593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938309.397312:0:15593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938309.397313:0:15593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938309.397315:0:15593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938309.397316:0:15593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938309.397318:0:15593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938309.397327:0:15593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1784938309.397329:0:15593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1784938309.397330:0:15593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938309.397331:0:15593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938309.397332:0:15593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938309.397333:0:15593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938309.397334:0:15593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938309.397335:0:15593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938309.397336:0:15593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938309.397337:0:15593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1784938309.397374:0:15593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1784938309.397402:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550592:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1784938309.397496:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.397588:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6780 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.398016:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550592 00000100:00100000:2.0:1784938309.398027:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550592 00000100:00100000:2.0:1784938309.398103:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1784938309.398115:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:15593:x1871643065550592:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938309.398176:0:14280:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1784938309.398180:0:14280:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1784938309.398185:0:14280:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1784938309.409049:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:15593:x1871643065550592:12345-0@lo:253:mount.lustre.0 Request processed in 10925us (11541us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.409064:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1784938309.409185:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1784938309.409200:0:15593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1784938309.409203:0:15593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1784938309.409204:0:15593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1784938309.409206:0:15593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1784938309.409207:0:15593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1784938309.409208:0:15593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1784938309.409209:0:15593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1784938309.409210:0:15593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1784938309.409239:0:15593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1784938309.409241:0:15593:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1784938309.409266:0:15593:0:(tgt_mount.c:101:server_register_mount()) register mount ffffa05afc8a4000 from lustre-OST0001 10000000:01000000:1.0:1784938309.409296:0:15593:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1784938309.409299:0:15593:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784938309.409306:0:15593:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffffa05ad1a219c0 local copy 00010000:00010000:1.0:1784938309.409316:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.409599:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550720:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.409659:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.409712:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6600 going to sleep for 11 seconds 00000100:00100000:3.0:1784938309.409874:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550720 00000100:00100000:3.0:1784938309.409884:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550720 00000100:00100000:3.0:1784938309.409922:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1784938309.409931:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:15593:x1871643065550720:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938309.410211:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:15593:x1871643065550720:12345-0@lo:501:mount.lustre.0 Request processed in 279us (550us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938309.410249:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1784938309.410447:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550720:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1784938309.410463:0:15593:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1784938309.410632:0:15593:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1784938309.410652:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.410661:0:15593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d800/0xea86628a8aec470d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4714 expref: -99 pid: 14270 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938309.410689:0:15593:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffffa05afc8a4000 10000000:01000000:1.0:1784938309.410695:0:15593:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1784938309.410700:0:15593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1784938309.410703:0:15593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938309.410708:0:15593:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1784938309.410710:0:15593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1784938309.410741:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.410748:0:15593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.410756:0:15593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.410770:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550848:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938309.410801:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.410873:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6600 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.411175:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550848 00000100:00100000:2.0:1784938309.411182:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550848 00000100:00100000:2.0:1784938309.411259:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1784938309.411268:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:15593:x1871643065550848:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938309.411282:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938309.411297:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892a00/0xea86628a8aec4975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec496e expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.411320:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892a00/0xea86628a8aec4975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec496e expref: 17 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.411332:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892a00/0xea86628a8aec4975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec496e expref: 17 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.411351:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892a00, rc 0) 00000100:00100000:2.0:1784938309.411402:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065550848:12345-0@lo:101:mount.lustre.0 Request processed in 135us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.411410:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1784938309.411510:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550848:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938309.411534:0:15593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4975 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.411543:0:15593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4975 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938309.412508:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1784938309.414269:0:15593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938309.414766:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1784938309.414808:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1784938309.414836:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1784938309.414875:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1784938309.414903:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1784938309.414927:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1784938309.414978:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1784938309.414985:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1784938309.415080:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.415150:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.415202:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6840 going to sleep for 11 seconds 00000100:00100000:0.0:1784938309.415674:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065550976 00000100:00100000:0.0:1784938309.415685:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065550976 00000100:00100000:0.0:1784938309.415751:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1784938309.415760:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065550976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938309.416367:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065550976:12345-0@lo:501:mount.lustre.0 Request processed in 605us (1213us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.416377:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1784938309.416878:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065550976:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.416940:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551104:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938309.417000:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.417087:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.418479:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551104 00000100:00100000:2.0:1784938309.418496:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551104 00000100:00100000:2.0:1784938309.418575:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1784938309.418585:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551104:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1784938309.419072:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551104:12345-0@lo:503:mount.lustre.0 Request processed in 487us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.419082:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1784938309.419367:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551104:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938309.420107:0:15593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938309.420209:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551232:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.420313:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.420361:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.420698:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551232 00000100:00100000:2.0:1784938309.420710:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551232 00000100:00100000:2.0:1784938309.420774:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1784938309.420785:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551232:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938309.421052:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551232:12345-0@lo:502:mount.lustre.0 Request processed in 268us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.421059:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1784938309.422238:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551232:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938309.422579:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1784938309.422776:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1784938309.422819:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1784938309.422868:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1784938309.422903:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1784938309.422935:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1784938309.422985:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1784938309.423022:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1784938309.423070:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1784938309.423117:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551360:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.423184:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.423258:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6840 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.424498:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551360 00000100:00100000:2.0:1784938309.424516:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551360 00000100:00100000:1.0:1784938309.426306:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1784938309.426334:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551360:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.428025:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551360:12345-0@lo:502:mount.lustre.0 Request processed in 1686us (4825us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.428045:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1784938309.428247:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551360:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1784938309.428459:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1784938309.428480:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1784938309.431868:0:15594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1784938309.431880:0:15594:0:(obd_mount.c:957:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1784938309.431894:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1784938309.431896:0:15594:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1784938309.431904:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1784938309.431925:0:15594:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffffa05afbeb99c0) 00000020:00000080:2.0:1784938309.431954:0:15594:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1784938309.431960:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1784938309.432034:0:15594:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05afc8a4000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1784938309.432046:0:15594:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1784938309.432057:0:15594:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xea86628a8aec4983 00010000:00010000:3.0:1784938309.439868:0:15594:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1784938309.440418:0:15594:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1784938309.442069:0:15594:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1784938309.444930:0:15594:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1784938309.444946:0:15594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938309.444955:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.444958:0:15594:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1784938309.444962:0:15594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938309.444966:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.444968:0:15594:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1784938309.444971:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1784938309.444973:0:15594:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1784938309.444975:0:15594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938309.444977:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.444978:0:15594:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1784938309.444981:0:15594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938309.444983:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.444984:0:15594:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1784938309.444988:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1784938309.445069:0:15594:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938309.445072:0:15594:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.445074:0:15594:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1784938309.445078:0:15594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1784938309.445399:0:15593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1784938309.445436:0:15593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1784938309.445461:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4975 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.445474:0:15593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8990a00/0xea86628a8aec496e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4975 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938309.445502:0:15593:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05afc8a4000 from 1 10000000:01000000:3.0:1784938309.445505:0:15593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1784938309.445543:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.445552:0:15593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.445575:0:15593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938309.445603:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551488:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1784938309.445688:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938309.445734:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada3d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938309.445790:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551488 00000100:00100000:1.0:1784938309.445798:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551488 00000100:00100000:1.0:1784938309.445851:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1784938309.445861:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:15593:x1871643065551488:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938309.445876:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938309.445907:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec498a expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.445938:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec498a expref: 18 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.445957:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec498a expref: 18 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.445967:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991a00, rc 0) 00000100:00100000:1.0:1784938309.446012:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551488:12345-0@lo:101:mount.lustre.0 Request processed in 153us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.446020:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1784938309.446621:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551488:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1784938309.446652:0:15593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938309.446664:0:15593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938309.447471:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1784938309.451196:0:15593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1784938309.451501:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1784938309.451547:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1784938309.451629:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1784938309.453739:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1784938309.455181:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551616:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1784938309.455275:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938309.457019:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ada3d1180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938309.460893:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551616 00000100:00100000:1.0:1784938309.460918:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551616 00000100:00100000:1.0:1784938309.461007:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784938309.461019:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551616:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.461415:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551616:12345-0@lo:501:mount.lustre.0 Request processed in 397us (6139us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.461425:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1784938309.461504:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551616:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.461580:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551744:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938309.461630:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.461669:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938309.462678:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551744 00000100:00100000:3.0:1784938309.462691:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551744 00000100:00100000:3.0:1784938309.462752:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1784938309.462760:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551744:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1784938309.463194:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551744:12345-0@lo:503:mount.lustre.0 Request processed in 434us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938309.463201:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1784938309.464836:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551744:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938309.468792:0:15593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938309.468906:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.469009:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.469051:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1784938309.469108:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065551872 00000100:00100000:3.0:1784938309.469116:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065551872 00000100:00100000:3.0:1784938309.469166:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1784938309.469175:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1784938309.470177:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4128c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065551872:12345-0@lo:502:mount.lustre.0 Request processed in 997us (1164us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938309.470188:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1784938309.475892:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065551872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938309.476860:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1784938309.476958:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1784938309.477020:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1784938309.477060:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1784938309.477096:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1784938309.477145:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1784938309.477181:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1784938309.477254:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1784938309.477307:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552000:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.478490:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.478552:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.478933:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552000 00000100:00100000:2.0:1784938309.478946:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552000 00000100:00100000:2.0:1784938309.479020:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1784938309.479031:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065552000:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938309.479377:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4129850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065552000:12345-0@lo:502:mount.lustre.0 Request processed in 346us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.479385:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1784938309.479666:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552000:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1784938309.479822:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1784938309.479842:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1784938309.482908:0:15598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938309.482923:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.482926:0:15598:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1784938309.482934:0:15598:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05afc8a4000 00000020:00000080:0.0:1784938309.482936:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938309.482963:0:15598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938309.482966:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.482967:0:15598:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1784938309.482970:0:15598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938309.482972:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.482973:0:15598:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1784938309.482976:0:15598:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffffa05afc8a4000 00000020:00000080:0.0:1784938309.482979:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938309.483055:0:15598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938309.483060:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.483061:0:15598:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1784938309.483063:0:15598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1784938309.483066:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.483067:0:15598:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1784938309.483070:0:15598:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffffa05afc8a4000 00000020:00000080:0.0:1784938309.483073:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1784938309.483108:0:15598:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1784938309.483111:0:15598:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1784938309.483113:0:15598:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1784938309.483116:0:15598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1784938309.484761:0:15593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1784938309.484808:0:15593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1784938309.484835:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.484850:0:15593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1784938309.484900:0:15593:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1784938309.484902:0:15593:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffffa05afc8a4000 10000000:01000000:1.0:1784938309.484906:0:15593:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffffa05afc8a4000 10000000:01000000:1.0:1784938309.484911:0:15593:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1784938309.484917:0:15593:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffffa05afc8a4000 from 1 10000000:01000000:1.0:1784938309.484920:0:15593:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1784938309.484969:0:15593:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.484978:0:15593:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.485005:0:15593:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.485040:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1784938309.485142:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.485266:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.492237:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552128 00000100:00100000:2.0:1784938309.492257:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552128 00000100:00100000:2.0:1784938309.492321:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1784938309.492330:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065552128:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1784938309.492348:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938309.492370:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc893800/0xea86628a8aec499f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4998 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.492399:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc893800/0xea86628a8aec499f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4998 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.492412:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc893800/0xea86628a8aec499f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4998 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.492436:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893800, rc 0) 00000100:00100000:2.0:1784938309.492526:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4128050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552128:12345-0@lo:101:mount.lustre.0 Request processed in 197us (7384us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.492535:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1784938309.492791:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552128:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1784938309.492817:0:15593:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec499f expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938309.492828:0:15593:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec499f expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938309.493533:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1784938309.493897:0:15593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938309.494184:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1784938309.494263:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1784938309.494301:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1784938309.494349:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1784938309.494386:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1784938309.494437:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1784938309.494475:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1784938309.494511:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1784938309.494575:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1784938309.494629:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1784938309.494664:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1784938309.494715:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1784938309.494753:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1784938309.494788:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1784938309.494854:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1784938309.494897:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1784938309.495018:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1784938309.495071:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1784938309.495112:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1784938309.495149:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1784938309.495194:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1784938309.495268:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1784938309.495308:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1784938309.495362:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1784938309.495403:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1784938309.495460:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1784938309.495513:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1784938309.495550:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1784938309.504392:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1784938309.504477:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1784938309.504514:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1784938309.504550:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1784938309.504601:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1784938309.505888:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1784938309.505967:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1784938309.506021:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1784938309.506060:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1784938309.506171:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1784938309.506179:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1784938309.506531:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.506619:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938309.507573:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552256 00000100:00100000:0.0:1784938309.507587:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552256 00000100:00100000:0.0:1784938309.507723:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1784938309.507734:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552256:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1784938309.508063:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552256:12345-0@lo:501:mount.lustre.0 Request processed in 330us (1443us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.508071:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1784938309.508144:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938309.508173:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552256:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1784938309.508255:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552384:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938309.508312:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.508340:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552384 00000100:00100000:1.0:1784938309.508343:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552384 00000100:00100000:1.0:1784938309.508371:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784938309.508378:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552384:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1784938309.510998:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552384:12345-0@lo:503:mount.lustre.0 Request processed in 2604us (2669us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.511017:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1784938309.511103:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6180 going to sleep for 11 seconds 00000100:00100000:1.0:1784938309.511133:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552384:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1784938309.516203:0:15593:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1784938309.516326:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552512:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.516415:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.516464:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6180 going to sleep for 11 seconds 00000100:00100000:0.0:1784938309.516629:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552512 00000100:00100000:0.0:1784938309.516700:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552512 00000100:00100000:0.0:1784938309.516753:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1784938309.516761:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552512:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1784938309.517037:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552512:12345-0@lo:502:mount.lustre.0 Request processed in 276us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.517045:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1784938309.525690:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938309.526083:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1784938309.526152:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1784938309.526189:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1784938309.526265:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1784938309.526303:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1784938309.526349:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1784938309.526384:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1784938309.526420:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1784938309.526468:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1784938309.526502:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1784938309.526535:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1784938309.526596:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1784938309.526645:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1784938309.526677:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1784938309.526724:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1784938309.526756:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1784938309.526804:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1784938309.526851:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1784938309.526883:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1784938309.526914:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1784938309.526959:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1784938309.526995:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1784938309.527029:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1784938309.527078:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1784938309.527114:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1784938309.527148:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1784938309.527193:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1784938309.527264:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1784938309.527300:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1784938309.527346:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1784938309.527381:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1784938309.527416:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1784938309.527470:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1784938309.527519:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1784938309.527573:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1784938309.527625:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1784938309.527663:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1784938309.527695:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1784938309.527750:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1784938309.527792:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1784938309.527855:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552640:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1784938309.527967:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938309.528025:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ad1be6180 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.528158:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552640 00000100:00100000:2.0:1784938309.528167:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552640 00000100:00100000:2.0:1784938309.528273:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1784938309.528285:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552640:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1784938309.528573:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065552640:12345-0@lo:502:mount.lustre.0 Request processed in 290us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.528583:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1784938309.529112:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065552640:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1784938309.532767:0:15593:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1784938309.532803:0:15593:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1784938309.538411:0:15603:0:(obd_mount.c:226:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1784938309.538458:0:15603:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffffa059c1f719c0) 00000020:00000080:1.0:1784938309.538492:0:15603:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1784938309.538685:0:15603:0:(tgt_mount.c:153:server_get_mount()) get mount ffffa05afc8a4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784938309.538690:0:15603:0:(tgt_mount.c:187:server_put_mount()) put mount ffffa05afc8a4000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1784938309.538693:0:15603:0:(obd_mount.c:706:lustre_put_lsi()) put ffffa05afc8a4000 3 00010000:00080000:1.0:1784938309.538735:0:15603:0:(ldlm_lib.c:125:import_set_conn()) imp ffffa05ac9b49800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1784938309.540360:0:15603:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1784938309.540483:0:15603:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1784938309.540526:0:15603:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1784938309.540543:0:15603:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xea86628a8aec49ad 00000100:00080000:1.0:1784938309.540569:0:15603:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 192.168.201.158@tcp last attempt 0 00000100:00080000:1.0:1784938309.540582:0:15603:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffffa05ac9b49800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784938309.540622:0:15603:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c354aa00 x1871643065552768/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1784938309.540661:0:15603:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1784938309.540726:0:11402:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938309.540731:0:11402:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784938309.540733:0:11402:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938309.540739:0:11402:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 192.168.201.158@tcp last attempt 517 00000100:00080000:1.0:1784938309.540743:0:11402:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1784938309.540747:0:11402:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa05af410a800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784938309.540760:0:11402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c3548700 x1871643065553024/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938309.540834:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065552896:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938309.540924:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1784938309.540930:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065553152:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938309.540982:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065553280:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938309.541210:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938309.541311:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938309.541336:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938309.541373:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553152 00000100:00100000:1.0:1784938309.541381:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553152 00000100:00100000:1.0:1784938309.541432:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553280 00000100:00100000:1.0:1784938309.541435:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553280 00000100:00100000:1.0:1784938309.541459:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:1.0:1784938309.541468:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065553152:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938309.541520:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3549880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1871643065553152:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 52us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938309.541527:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:1.0:1784938309.541545:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:2.0:1784938309.541849:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1871643065552768:192.168.201.158@tcp:38:llog_process_th.0 00000100:00100000:2.0:1784938309.541910:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065553024:192.168.201.158@tcp:8:kworker.0 00000100:00100000:0.0:1784938309.547897:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552896 00000100:00100000:0.0:1784938309.547916:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552896 00000100:00100000:0.0:1784938309.548010:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:0.0:1784938309.548024:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065552896:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938309.548136:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3548380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065552896:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 115us (6823us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.548146:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00000040:00080000:0.0:1784938309.550289:0:15603:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:1.0:1784938309.550854:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065553280:12345-192.168.201.158@tcp:400:kworker.0 00000020:01000000:2.0:1784938309.551199:0:15593:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1784938309.551242:0:15593:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1784938309.551259:0:15593:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec499f expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.551270:0:15593:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac8990000/0xea86628a8aec4998 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec499f expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1784938309.551348:0:15593:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1784938309.551352:0:15593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938309.551354:0:15593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938309.551355:0:15593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938309.551357:0:15593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938309.551363:0:15593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938309.551365:0:15593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938309.551367:0:15593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938309.551369:0:15593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784938309.551375:0:15593:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1784938309.551377:0:15593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1784938309.551379:0:15593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938309.551380:0:15593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938309.551381:0:15593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938309.551382:0:15593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938309.551383:0:15593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938309.551384:0:15593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938309.551385:0:15593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938309.551385:0:15593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1784938309.551422:0:15593:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1784938309.551447:0:15593:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065553408:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1784938309.551523:0:15593:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938309.551572:0:15593:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05af52d43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938309.560485:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553408 00000100:00100000:2.0:1784938309.560500:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553408 00000100:00100000:2.0:1784938309.560581:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1784938309.560592:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:15593:x1871643065553408:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1784938309.560635:0:14282:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1784938309.560650:0:14282:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1784938309.563396:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938309.563436:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938309.563524:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065552768 00000100:00100000:0.0:1784938309.563535:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065552768 00000100:00100000:0.0:1784938309.563593:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938309.563602:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3320:x1871643065552768:12345-192.168.201.158@tcp:38:llog_process_th.0 00010000:00080000:0.0:1784938309.563635:0:14290:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 518 last 0 00000020:00000080:0.0:1784938309.563685:0:14290:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xea86628a8aec49b4 00000004:00100000:0.0:1784938309.563702:0:14290:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1784938309.563750:0:14290:0:(import.c:65:import_set_state_nolock()) ffffa05ae7d14800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938309.563810:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3320:x1871643065552768:12345-192.168.201.158@tcp:38:llog_process_th.0 Request processed in 207us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.563817:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938309.563844:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553024 00000100:00100000:0.0:1784938309.563861:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553024 00000100:00100000:0.0:1784938309.563883:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:0.0:1784938309.563887:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065553024:12345-192.168.201.158@tcp:8:kworker.0 00000100:00100000:0.0:1784938309.563923:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065553024:12345-192.168.201.158@tcp:8:kworker.0 Request processed in 34us (486us total) trans 0 rc -11/-11 00000100:00100000:0.0:1784938309.563929:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00010000:00080000:3.0:1784938309.564572:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa059c3548e00 x1871643065553152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938309.564589:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3323:1871643065553152:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938309.564606:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065552896:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938309.565898:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3548000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1871643065553280:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 24338us (24551us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.565912:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 9 00010000:00080000:1.0:1784938309.566313:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa059c354aa00 x1871643065552768/t0(0) o38->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 520/416 e 0 to 0 dl 1784938319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938309.566324:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938309.566333:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1784938309.566341:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1784938309.566358:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1784938309.566363:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05ac9b49800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1784938309.566371:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3320:1871643065552768:192.168.201.158@tcp:38:llog_process_th.0 00000100:00100000:1.0:1784938309.566390:0:3320:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1784938309.566393:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1784938309.566397:0:3320:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.201.158@tcp failed (-11) 00000100:00100000:1.0:1784938309.566400:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065553024:192.168.201.158@tcp:8:kworker.0 00010000:00080000:1.0:1784938309.566437:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffffa059c354b800 x1871643065553280/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1784938309.566446:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3321:1871643065553280:192.168.201.158@tcp:400:kworker.0 20000000:01000000:0.0:1784938309.610625:0:14282:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1784938309.610653:0:14282:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1784938309.610865:0:14304:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1784938309.610872:0:14304:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1784938309.610897:0:14304:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.610921:0:14304:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4887 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.610930:0:14304:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.611001:0:14304:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec4887 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.611019:0:14304:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec4887 expref: 19 pid: 14283 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.611038:0:14304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14304:1871643065553536:0@lo:104: 00000100:00100000:2.0:1784938309.611123:0:14304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938309.611174:0:14304:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac823ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938309.611740:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553536 00000100:00100000:0.0:1784938309.611749:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553536 00000100:00100000:0.0:1784938309.611805:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938309.611816:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14304:x1871643065553536:12345-0@lo:104: 00010000:00010000:0.0:1784938309.611834:0:14272:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.611903:0:14272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938309.611909:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:14304:x1871643065553536:12345-0@lo:104: Request processed in 95us (787us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.611918:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1784938309.611946:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938309.611953:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.611960:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030400 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:0.0:1784938309.611964:0:14276:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.611990:0:14276:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1784938309.611997:0:14276:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938309.612003:0:14276:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1784938309.612041:0:14276:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612048:0:14276:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1784938309.612073:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612081:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec4887 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec488e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612103:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938309.612105:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938309.612107:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1784938309.612130:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065553664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938309.612166:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938309.612234:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553664 00000100:00100000:0.0:1784938309.612239:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553664 00010000:00010000:0.0:1784938309.612259:0:14275:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec4887 expref: 20 pid: 14283 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938309.612290:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938309.612297:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+20:3322:x1871643065553664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938309.612314:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938309.612320:0:14275:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec4887 expref: 20 pid: 14283 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612331:0:14275:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec4887 expref: 20 pid: 14283 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612349:0:14275:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612357:0:14275:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1784938309.612371:0:14275:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002854713s 00010000:00010000:0.0:1784938309.612376:0:14275:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612383:0:14275:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612390:0:14275:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612397:0:14275:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612403:0:14275:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938309.612407:0:14275:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612414:0:14275:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612430:0:14275:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938309.612441:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938309.612474:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+20:3322:x1871643065553664:12345-0@lo:103:ldlm_bl.0 Request processed in 178us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938309.612481:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1784938309.612523:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065553664:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938309.613393:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8990e00/0xea86628a8aec488e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec4887 expref: 19 pid: 14283 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938309.613413:0:14304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14304:1871643065553536:0@lo:104: 00010000:00010000:2.0:1784938309.613433:0:14304:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.613443:0:14304:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.613449:0:14304:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938309.613455:0:14304:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892800/0xea86628a8aec49bb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14304 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938309.627629:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:15593:x1871643065553408:12345-0@lo:253:mount.lustre.0 Request processed in 67027us (76092us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938309.627738:0:15593:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:d8a94b82-749f-4608-8cc0-c15cba2ced0a:15593:1871643065553408:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1784938309.627765:0:15593:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1784938309.627769:0:15593:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1784938309.627786:0:15593:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1784938309.627787:0:15593:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1784938309.627789:0:15593:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1784938309.627791:0:15593:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1784938309.627792:0:15593:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1784938309.627793:0:15593:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1784938309.627795:0:15593:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1784938309.627797:0:15593:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1784938309.627816:0:15593:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:1.0:1784938309.628422:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00080000:10000000:2.0:1784938309.633708:0:15593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938309.633904:0:15593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938309.634076:0:15593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938309.635035:0:15593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1784938309.636658:0:15593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1784938309.636972:0:15593:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1784938309.638772:0:15593:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1784938309.718743:0:15593:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1784938309.718754:0:15593:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1784938309.718790:0:15593:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1784938309.718858:0:15593:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1784938309.718873:0:15593:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1784938309.718904:0:15593:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1784938309.812201:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1784938310.513859:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1784938310.705396:0:14285:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1784938310.705405:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffffa05aff9ff000 from 8 10000000:01000000:0.0:1784938310.705410:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1784938310.705462:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.705485:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.705497:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938310.705526:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065553792:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938310.705884:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938310.705947:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1784938310.713863:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553792 00000100:00100000:1.0:1784938310.713884:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553792 00000100:00100000:1.0:1784938310.713945:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784938310.713957:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065553792:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938310.713975:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938310.713996:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990400/0xea86628a8aec49c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec49c2 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.714024:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990400/0xea86628a8aec49c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec49c2 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.714036:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990400/0xea86628a8aec49c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec49c2 expref: 19 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.714056:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990400, rc 0) 00000100:00100000:1.0:1784938310.714148:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065553792:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 192us (8263us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938310.714155:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1784938310.714259:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065553792:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938310.714280:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec49c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938310.714289:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec49c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938310.714357:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065553920:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1784938310.714403:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938310.714435:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac823ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1784938310.714451:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065553920 00000100:00100000:1.0:1784938310.714455:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065553920 00000100:00100000:3.0:1784938310.714756:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784938310.714767:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065553920:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1784938310.714787:0:14280:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1784938310.714815:0:14280:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1784938310.714818:0:14280:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1784938310.714910:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065553920:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 146us (507us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938310.714918:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1784938310.714956:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065553920:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1784938310.715017:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1784938310.715026:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec49c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938310.715035:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac0030400/0xea86628a8aec49c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec49c9 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938310.835841:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938311.865000:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938312.881814:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938313.273006:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065554048:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938313.273571:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938313.273959:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554048 00000100:00100000:0.0:1784938313.273969:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554048 00000100:00100000:0.0:1784938313.274039:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:0.0:1784938313.274050:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065554048:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938313.274095:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938313.274148:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065554048:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 99us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938313.274156:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00080000:1.0:1784938313.274577:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938313.282056:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065554048:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:0.0:1784938313.905551:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1784938314.810408:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1784938314.810417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1784938314.810421:0:37:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1784938314.810440:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffffa05af410a800 using connection 192.168.201.158@tcp/192.168.201.158@tcp 00000100:00100000:1.0:1784938314.810478:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffffa059c354a300 x1871643065554432/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1784938314.810586:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065554176:0@lo:400:kworker.0 00000100:00100000:1.0:1784938314.810693:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938314.810743:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065554816:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938314.810802:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1784938314.810809:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065554688:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938314.810850:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065554304:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938314.810874:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938314.810879:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065554560:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938314.810911:0:3320:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065554432:192.168.201.158@tcp:8:kworker.0 00000100:00100000:1.0:1784938314.811164:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554176 00000100:00100000:1.0:1784938314.811171:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554176 00000100:00100000:1.0:1784938314.811239:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784938314.811249:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3324:x1871643065554176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938314.811304:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3324:x1871643065554176:12345-0@lo:400:kworker.0 Request processed in 57us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938314.811311:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1784938314.811545:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938314.811601:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938314.811624:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938314.811648:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938314.811666:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938314.811714:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065554176:0@lo:400:kworker.0 00000100:00100000:1.0:1784938314.812051:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554688 00000100:00100000:1.0:1784938314.812057:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554688 00000100:00100000:1.0:1784938314.812142:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554560 00000100:00100000:1.0:1784938314.812156:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554560 00000100:00100000:1.0:1784938314.812172:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554816 00000100:00100000:1.0:1784938314.812174:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554816 00000100:00100000:0.0:1784938314.820296:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554304 00000100:00100000:0.0:1784938314.820313:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554304 00000100:00100000:0.0:1784938314.820364:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554432 00000100:00100000:0.0:1784938314.820367:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554432 00000100:00100000:0.0:1784938314.820383:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:0.0:1784938314.820393:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065554304:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938314.820494:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065554304:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 102us (8844us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938314.820503:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 2 00000100:00100000:0.0:1784938314.820526:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:0.0:1784938314.820530:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3320:x1871643065554432:12345-192.168.201.158@tcp:8:kworker.0 00010000:00080000:0.0:1784938314.820574:0:14924:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@192.168.201.158@tcp t0 exp 0000000000000000 cur 523 last 0 00000020:00000080:0.0:1784938314.820605:0:14924:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xea86628a8aec49d0 00002000:00100000:0.0:1784938314.820618:0:14924:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffffa05aff988000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136cb ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1784938314.820623:0:14924:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1784938314.820625:0:14924:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1784938314.821049:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:0.0:1784938314.823165:0:14924:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1784938314.823242:0:14924:0:(import.c:65:import_set_state_nolock()) ffffa05aff98d800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1784938314.823328:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3320:x1871643065554432:12345-192.168.201.158@tcp:8:kworker.0 Request processed in 2794us (11658us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938314.823339:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:1.0:1784938314.823348:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00100000:1.0:1784938314.823360:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065554688:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938314.823371:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:0.0:1784938314.823378:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065554560:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938314.823399:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3548e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065554688:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 43us (11856us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938314.823400:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065554560:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23us (11799us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938314.823406:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00100000:0.0:1784938314.828891:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:0.0:1784938314.828948:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:0.0:1784938314.828966:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065554816:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938314.829055:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065554816:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 96us (17429us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938314.829062:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00010000:00080000:0.0:1784938314.829422:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c3548700 x1871643065554560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938314.829441:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c3548700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065554560:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938314.829455:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065554304:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938314.829516:0:3320:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c354a300 x1871643065554432/t0(0) o8->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:28/4 lens 520/416 e 0 to 0 dl 1784938339 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1784938314.829531:0:3320:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1784938314.831310:0:3320:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1784938314.831330:0:3320:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1784938314.831365:0:3320:0:(import.c:65:import_set_state_nolock()) ffffa05af410a800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1784938314.831446:0:3320:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1784938314.831459:0:3320:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3320:1871643065554432:192.168.201.158@tcp:8:kworker.0 00010000:00080000:0.0:1784938314.831670:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c354b800 x1871643065554688/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938314.831686:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065554688:192.168.201.158@tcp:400:kworker.0 00010000:00080000:0.0:1784938314.831709:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c354b480 x1871643065554816/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1784938314.831718:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065554816:192.168.201.158@tcp:400:kworker.0 00000004:00080000:0.0:1784938314.831747:0:14312:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1784938314.832389:0:14312:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 523775172463ns, next at 0ns, rc = 0 00000004:00080000:2.0:1784938314.841743:0:14313:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:2.0:1784938314.841799:0:14313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14313:1871643065555072:192.168.201.158@tcp:5:osp-pre-1-0.0 00000100:00100000:2.0:1784938314.841901:0:14313:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68def00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938314.842517:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065554944:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938314.848410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938314.848454:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938314.848508:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555072 00000100:00100000:0.0:1784938314.848520:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555072 00000100:00100000:3.0:1784938314.849635:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065554944 00000100:00100000:3.0:1784938314.849646:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065554944 00000100:00100000:3.0:1784938314.849696:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:3.0:1784938314.849706:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065554944:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938314.849746:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1784938314.849885:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938314.850078:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:0.0:1784938314.850087:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14313:x1871643065555072:12345-192.168.201.158@tcp:5:osp-pre-1-0.0 00000100:00100000:3.0:1784938314.852784:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065554944:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 3057us (4306us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938314.853446:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00010000:00080000:3.0:1784938314.853702:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c1086680 x1871643065554944/t0(0) o13->lustre-OST0001-osc-MDT0000@192.168.201.158@tcp:7/4 lens 224/368 e 0 to 0 dl 1784938330 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938314.853741:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1086680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065554944:192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00080000:0.0:1784938314.863753:0:14924:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1784938314.864701:0:14924:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1784938314.864713:0:14924:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1784938314.882891:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.882905:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.882923:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.882927:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.882934:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.882953:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.882964:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.882972:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.883012:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1784938314.883818:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.883825:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.883835:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.883838:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.883843:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.883854:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.883862:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.883869:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.883891:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938314.884182:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938314.884193:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884204:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.884210:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884257:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884280:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884289:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec49d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884311:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938314.884314:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884321:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.884324:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938314.884326:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.884332:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884333:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884341:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=523s v=(0 0) 00010000:00010000:2.0:1784938314.884344:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884350:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938314.884351:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec49de lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884356:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884365:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884372:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.884373:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.884374:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.884376:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.884380:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884396:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938314.884405:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938314.884410:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884417:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938314.884420:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884427:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884438:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884455:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec49e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.884480:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.884482:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.884484:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.889135:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.895514:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.895528:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.895547:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.895552:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.895559:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.895574:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.895584:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.895591:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.895947:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938314.895954:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938314.895961:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.895970:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938314.895983:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.895993:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.896014:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.896021:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec49ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.896041:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.896043:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.896044:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.898027:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.898046:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.898063:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.898067:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.898074:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.898088:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.898099:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.898108:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.898207:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938314.899748:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938314.899776:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.899795:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.899801:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.899818:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.899850:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.899859:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec49f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.899891:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.899893:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.899895:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.900521:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.900530:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.900544:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.900549:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.900555:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.900568:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.900587:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.900595:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.907138:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938314.907175:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938314.907186:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.907204:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938314.907210:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.907255:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.907282:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.907290:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac88486d/0xea86628a8aec49fa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.907318:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.907328:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.907330:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.908052:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.908061:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.908077:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.908082:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.908090:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.908105:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.908115:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.908123:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.908146:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1784938314.908157:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1784938314.908161:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.911344:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938314.911364:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.911398:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.911422:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.911430:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a72683a2/0xea86628a8aec4a01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.911455:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.911458:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1784938314.911471:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.914534:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.914550:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.914567:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.914573:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.914580:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.914595:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.914608:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.915885:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.915911:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938314.917943:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938314.917959:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.917975:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.917993:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.918007:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.918034:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.918042:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3e1f505/0xea86628a8aec4a08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.918069:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.918071:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.918073:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1784938314.918911:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1784938314.922995:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.923012:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.923995:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.924005:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.924015:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.924118:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.924712:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.924725:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.924765:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938314.926705:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938314.926723:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.926738:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990c00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938314.926744:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.926757:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.926795:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.926814:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000adf02c8e/0xea86628a8aec4a0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.926841:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.926843:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.926845:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.928193:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.928212:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.929519:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.929525:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.929533:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.929550:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.929564:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.929573:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.929605:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938314.930679:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938314.930691:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.930702:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938314.930707:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.930717:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.930737:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.930745:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e0daf2e/0xea86628a8aec4a16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.930780:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.930782:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.930784:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.931099:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.934102:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.934119:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934141:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.934147:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.934155:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934172:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934196:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934206:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934249:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938314.934294:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938314.934302:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934311:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938314.934317:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934328:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934347:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934354:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d368150/0xea86628a8aec4a1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934373:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.934375:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.934377:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.934689:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.934695:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934703:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.934706:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.934710:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934718:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934725:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934732:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.934767:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1784938314.934841:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938314.934847:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934854:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938314.934858:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934877:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934889:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934896:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec9c8ce0/0xea86628a8aec4a24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.934909:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.934911:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.934926:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1784938314.935208:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1784938314.935231:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.935240:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=523s v=(0 0) 00010000:00010000:1.0:1784938314.935243:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938314.935247:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.935257:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.935264:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.935272:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938314.935293:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938314.935320:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938314.935326:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.935334:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.935338:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.935346:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.935357:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.935371:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec646e4f/0xea86628a8aec4a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.935387:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.935389:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.935391:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.936181:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.936189:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.936199:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.936203:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.936207:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.938962:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.938979:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.939008:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.939048:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938314.939695:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938314.939705:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.939714:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0030800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.939719:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.939729:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.939748:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.939757:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000640c2255/0xea86628a8aec4a32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.939852:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.939854:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.939855:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.940655:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.940665:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.940682:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.940687:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.940695:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.940708:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.940719:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.940726:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.940749:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938314.941164:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.941170:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941185:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.941189:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.941193:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941205:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941243:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941251:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941272:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1784938314.941654:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.941661:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941669:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.941673:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.941678:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941688:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941707:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941714:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.941727:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:0.0:1784938314.942112:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.942119:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.942128:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.942131:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.942136:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.942145:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.942154:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.942161:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.942180:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1784938314.942756:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1784938314.942776:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942786:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.942791:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942801:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942821:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942829:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cc13202/0xea86628a8aec4a39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942848:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1784938314.942851:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942864:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031800 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.942868:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942876:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942886:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942893:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a72a787/0xea86628a8aec4a40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942906:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938314.942909:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942928:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac0031600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.942932:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942939:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942948:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942962:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000922f4f08/0xea86628a8aec4a47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942975:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938314.942978:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.942989:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.942992:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.943000:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.943011:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.943017:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a11be9ee/0xea86628a8aec4a4e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.943028:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.943030:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.943032:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.943882:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.943892:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.944360:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.944370:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.944384:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.944388:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.944393:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.944405:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.944414:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.944420:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.944441:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1784938314.944954:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938314.944961:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.944977:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.944982:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.944992:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.945008:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.945016:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f322bbfa/0xea86628a8aec4a55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.945034:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.945035:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.945037:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.945388:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.945396:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.945404:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.945415:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.945420:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.945430:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.945437:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.945444:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.945505:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938314.946873:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.946884:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.946897:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.946900:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.946904:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.947879:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.947895:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.947911:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.948680:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938314.948690:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.948698:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.948703:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.948712:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.948731:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.948739:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001812a7ad/0xea86628a8aec4a5c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.949704:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938314.949713:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.949723:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:3.0:1784938314.949727:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.949736:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.949777:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938314.949786:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.949788:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.949790:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.950011:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784938314.950019:0:14924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e85929a2/0xea86628a8aec4a63 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.950086:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.951114:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.951123:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.951137:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.951141:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.951147:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.951160:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.951169:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.951175:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.951210:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1784938314.951638:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938314.951646:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.951655:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837c00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.951659:0:15346:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.951668:0:15346:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.951691:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.951699:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000022966dd6/0xea86628a8aec4a6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.951714:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.951716:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.951718:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.958906:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.958935:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.958953:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.958958:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.958965:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.958982:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.958993:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.959001:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.959138:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938314.959669:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.959676:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.959686:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.959696:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.959700:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.959711:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.959720:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.959726:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960143:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938314.960152:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960161:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.960167:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960176:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960195:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960203:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029e6644e/0xea86628a8aec4a71 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960256:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938314.960260:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960266:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.960270:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960277:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960288:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.960294:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.960296:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.960298:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938314.962885:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1784938314.962904:0:14924:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000023f38e1a/0xea86628a8aec4a78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1784938314.963864:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.963874:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.963889:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.963894:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.963900:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.963915:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.963932:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.963941:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.963964:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1784938314.964429:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.964436:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.964446:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.964449:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.964453:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.964474:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.964483:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.964491:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.964517:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1784938314.964950:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1784938314.964958:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.964967:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836600 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.964972:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.964994:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965013:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965022:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000314552f3/0xea86628a8aec4a7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965042:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938314.965045:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965051:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.965054:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965062:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965071:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965079:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060aa245f/0xea86628a8aec4a86 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.965105:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.965107:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.965109:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.965116:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938314.965696:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1784938314.968725:0:14924:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1784938314.968741:0:14924:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.968759:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=523s v=(0 0) 00010000:00010000:0.0:1784938314.968954:0:14924:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938314.968963:0:14924:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.968979:0:14924:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.968992:0:14924:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.968999:0:14924:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938314.969081:0:14924:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:0.0:1784938314.969308:0:14924:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1784938314.969411:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14313:x1871643065555072:12345-192.168.201.158@tcp:5:osp-pre-1-0.0 Request processed in 119319us (121010us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938314.969421:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 7 00000100:00100000:3.0:1784938314.969775:0:14313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14313:1871643065555072:192.168.201.158@tcp:5:osp-pre-1-0.0 00000004:00080000:3.0:1784938314.969794:0:14313:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1784938314.969846:0:14313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14313:1871643065555200:192.168.201.158@tcp:5:osp-pre-1-0.0 00000100:00100000:3.0:1784938314.969913:0:14313:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05af4181a80 going to sleep for 11 seconds 00000100:00100000:3.0:1784938314.970011:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938314.970041:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555200 00000100:00100000:3.0:1784938314.970047:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555200 00000100:00100000:3.0:1784938314.970095:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:3.0:1784938314.970105:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14313:x1871643065555200:12345-192.168.201.158@tcp:5:osp-pre-1-0.0 00002000:00080000:3.0:1784938314.970152:0:14925:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1784938314.976374:0:14276:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1784938314.976394:0:14276:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.976410:0:14276:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938314.976416:0:14276:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.976427:0:14276:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.976472:0:14276:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.976481:0:14276:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058217315/0xea86628a8aec4a8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14924 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938314.976531:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.976533:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938314.976886:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938315.003105:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14313:x1871643065555200:12345-192.168.201.158@tcp:5:osp-pre-1-0.0 Request processed in 32986us (33080us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784938315.003122:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 8 00000100:00100000:1.0:1784938315.003942:0:14313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14313:1871643065555200:192.168.201.158@tcp:5:osp-pre-1-0.0 00000004:00080000:1.0:1784938315.003960:0:14313:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1784938315.956966:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938316.980774:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1784938317.882511:0:15946:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1784938318.005157:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938318.385801:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065555328:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938318.386424:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938318.386996:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555328 00000100:00100000:0.0:1784938318.387020:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555328 00000100:00100000:0.0:1784938318.387099:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:0.0:1784938318.387111:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065555328:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:0.0:1784938318.387148:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938318.387207:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065555328:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 97us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938318.387239:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00080000:1.0:1784938318.387341:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938318.387530:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065555328:192.168.201.158@tcp:13:osp-pre-0-0.0 00010000:00010000:3.0:1784938319.026361:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938319.923835:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065555456:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938319.925201:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065555712:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938319.925297:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065556224:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938319.925327:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1784938319.925334:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065555840:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938319.926308:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938319.926342:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938319.926367:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938319.926946:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555712 00000100:00100000:0.0:1784938319.926956:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555712 00000100:00100000:0.0:1784938319.927018:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555840 00000100:00100000:0.0:1784938319.927022:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555840 00000100:00100000:0.0:1784938319.927051:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938319.927060:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065555712:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938319.928096:0:14925:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1784938319.928108:0:14925:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1784938319.928992:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1087800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065555712:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 1915us (2672us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938319.929006:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 3 00000100:00100000:0.0:1784938319.929035:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00100000:0.0:1784938319.929047:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065555840:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938319.929320:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556224 00000100:00100000:3.0:1784938319.929336:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556224 00000100:00100000:3.0:1784938319.929399:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:3.0:1784938319.929407:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065556224:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938319.937768:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938319.951385:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1085500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3321:x1871643065555840:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 22319us (24993us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938319.951402:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 4 00000100:00080000:0.0:1784938319.951455:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1784938319.951462:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938319.951933:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555456 00000100:00100000:0.0:1784938319.951944:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555456 00000100:00100000:0.0:1784938319.951992:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:0.0:1784938319.952001:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065555456:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:0.0:1784938319.952046:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1784938319.952111:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1871643065555456:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 111us (14354us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938319.952118:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:3.0:1784938319.952568:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1871643065556224:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 23156us (26219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938319.952581:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:3.0:1784938319.952719:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065555584:0@lo:400:kworker.0 00000100:00100000:3.0:1784938319.952771:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1784938319.952809:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065556096:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938319.952853:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1784938319.952860:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065555968:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938319.952936:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065555456:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:3.0:1784938319.953301:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938319.953324:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938319.953367:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065555840:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938319.953396:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065555712:192.168.201.158@tcp:400:kworker.0 00010000:00080000:3.0:1784938319.953416:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c1084700 x1871643065556224/t0(0) o400->lustre-MDT0000-lwp-OST0001@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1784938319.953427:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3321:1871643065556224:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938319.956301:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555584 00000100:00100000:0.0:1784938319.956315:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555584 00000100:00100000:0.0:1784938319.956444:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1784938319.956454:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3324:x1871643065555584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1784938319.956560:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3324:x1871643065555584:12345-0@lo:400:kworker.0 Request processed in 107us (3789us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938319.956569:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1784938319.956788:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1087b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065555584:0@lo:400:kworker.0 00000100:00100000:1.0:1784938319.961915:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556096 00000100:00100000:1.0:1784938319.961931:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556096 00000100:00100000:1.0:1784938319.962001:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065555968 00000100:00100000:1.0:1784938319.962005:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065555968 00000100:00100000:1.0:1784938319.962031:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:1.0:1784938319.962040:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065556096:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938319.962121:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065556096:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 82us (8820us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938319.962129:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:1.0:1784938319.962147:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00100000:1.0:1784938319.962153:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065555968:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938319.962178:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1871643065555968:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 25us (8854us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938319.962184:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 15 00000100:00080000:2.0:1784938319.980859:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1784938319.990866:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c1084380 x1871643065555968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938319.990892:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1084380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3324:1871643065555968:192.168.201.158@tcp:400:kworker.0 00010000:00080000:2.0:1784938319.990909:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffffa059c1085880 x1871643065556096/t0(0) o400->lustre-MDT0000-lwp-OST0000@192.168.201.158@tcp:12/10 lens 224/224 e 0 to 0 dl 1784938335 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1784938319.990917:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065556096:192.168.201.158@tcp:400:kworker.0 00010000:00010000:3.0:1784938320.057637:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938320.164346:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1784938320.164395:0:7507:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000040:00080000:1.0:1784938320.756520:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1784938320.856391:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.856437:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048780928 00000100:00100000:3.0:1784938320.856457:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048780928 00000100:00100000:3.0:1784938320.856508:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1784938320.856517:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2354:x1871643048780928:12345-192.168.201.58@tcp:250:mount.lustre.0 00010000:00080000:3.0:1784938320.856549:0:14283:0:(ldlm_lib.c:1468:target_handle_connect()) MGS: connection from 6c312038-c6a3-4205-976c-ee5db1f0f6fd@192.168.201.58@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:3.0:1784938320.856578:0:14283:0:(genops.c:1406:class_connect()) connect: client 6c312038-c6a3-4205-976c-ee5db1f0f6fd, cookie 0xea86628a8aec4a94 00000100:00080000:3.0:1784938320.856817:0:14283:0:(import.c:65:import_set_state_nolock()) ffffa059c204b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1784938320.856889:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+5:2354:x1871643048780928:12345-192.168.201.58@tcp:250:mount.lustre.0 Request processed in 371us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938320.856898:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:0.0:1784938320.866130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.866321:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781056 00000100:00100000:3.0:1784938320.866334:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781056 00000100:00100000:3.0:1784938320.866428:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:3.0:1784938320.866447:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+5:13707:x1871643048781056:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938320.866468:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938320.866491:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05aff87da00/0xea86628a8aec4a9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c45 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938320.866529:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87da00/0xea86628a8aec4a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c45 expref: 6 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938320.866542:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05aff87da00/0xea86628a8aec4a9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c45 expref: 6 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938320.866552:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87da00, rc 0) 00000100:00100000:3.0:1784938320.866616:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+6:13707:x1871643048781056:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 179us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938320.866624:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1784938320.869366:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.869796:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781184 00000100:00100000:3.0:1784938320.869822:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781184 00000100:00100000:3.0:1784938320.869877:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:3.0:1784938320.869887:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+6:13707:x1871643048781184:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784938320.870191:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+6:13707:x1871643048781184:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 304us (843us total) trans 0 rc -2/-2 00000100:00100000:3.0:1784938320.870199:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:0.0:1784938320.872797:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.872887:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781312 00000100:00100000:3.0:1784938320.872898:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781312 00000100:00100000:3.0:1784938320.872954:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1784938320.872964:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+6:13707:x1871643048781312:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:3.0:1784938320.872993:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938320.873015:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05aff87c000/0xea86628a8aec4aa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c4c expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938320.873053:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05aff87c000/0xea86628a8aec4aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c4c expref: 7 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938320.873066:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05aff87c000/0xea86628a8aec4aa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c4c expref: 7 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938320.873075:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c000, rc 0) 00000100:00100000:3.0:1784938320.873138:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+7:13707:x1871643048781312:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 175us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938320.873145:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:0.0:1784938320.880267:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.880373:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781440 00000100:00100000:3.0:1784938320.880391:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781440 00000100:00100000:3.0:1784938320.880460:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1784938320.880471:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+7:13707:x1871643048781440:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1784938320.882612:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13707:x1871643048781440:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 2129us (2382us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938320.882628:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:0.0:1784938320.892623:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938320.898817:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781568 00000100:00100000:1.0:1784938320.898844:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781568 00000100:00100000:1.0:1784938320.898956:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1784938320.898968:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13707:x1871643048781568:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784938320.899262:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13707:x1871643048781568:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 296us (6652us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938320.899271:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:0.0:1784938320.902412:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.902609:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781696 00000100:00100000:3.0:1784938320.902619:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781696 00000100:00100000:3.0:1784938320.902679:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:3.0:1784938320.902690:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13726:x1871643048781696:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938320.903002:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13726:x1871643048781696:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 313us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938320.903011:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:0.0:1784938320.932346:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.941445:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781824 00000100:00100000:3.0:1784938320.941468:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781824 00000100:00100000:0.0:1784938320.941695:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:0.0:1784938320.941707:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13726:x1871643048781824:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938320.942055:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13726:x1871643048781824:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 349us (9723us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938320.942064:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:0.0:1784938320.963679:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938320.963783:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048781952 00000100:00100000:1.0:1784938320.963794:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048781952 00000100:00100000:1.0:1784938320.963862:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1784938320.963875:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af412c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+8:13707:x1871643048781952:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938320.963903:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938320.963931:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec4aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c76 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938320.963966:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec4aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c76 expref: 9 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938320.963980:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8990c00/0xea86628a8aec4aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c76 expref: 9 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938320.963990:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990c00, rc 0) 00000100:00100000:1.0:1784938320.964081:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af412c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+9:13707:x1871643048781952:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 208us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938320.964088:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1784938320.968845:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938320.969142:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782080 00000100:00100000:3.0:1784938320.969156:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782080 00000100:00100000:3.0:1784938320.969267:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:3.0:1784938320.969278:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+9:13707:x1871643048782080:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1784938320.969308:0:14282:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1784938320.969335:0:14282:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1784938320.969340:0:14282:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1784938320.969343:0:14282:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1784938320.969346:0:14282:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784938320.972291:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+9:13707:x1871643048782080:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 3000us (3447us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938320.972309:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:3.0:1784938320.977625:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938320.977907:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782208 00000100:00100000:0.0:1784938320.977919:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782208 00000100:00100000:0.0:1784938320.977999:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1784938320.978010:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+9:13707:x1871643048782208:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784938320.978033:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938320.978067:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897c7d expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938320.978099:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 10 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938320.978112:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 10 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938320.978122:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6837200, rc 0) 00000100:00100000:0.0:1784938320.978194:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13707:x1871643048782208:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 185us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938320.978201:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:1.0:1784938320.982004:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938320.982428:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782336 00000100:00100000:0.0:1784938320.982540:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782336 00000100:00100000:0.0:1784938320.982604:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1784938320.982613:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13707:x1871643048782336:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784938320.983069:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13707:x1871643048782336:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 455us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938320.983085:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:2.0:1784938320.990170:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938320.990314:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782464 00000100:00100000:1.0:1784938320.990326:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782464 00000100:00100000:1.0:1784938320.990414:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:1.0:1784938320.990424:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13707:x1871643048782464:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:1.0:1784938320.991037:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13707:x1871643048782464:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 612us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938320.991047:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:2.0:1784938321.001706:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938321.002029:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782592 00000100:00100000:0.0:1784938321.002053:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782592 00000100:00100000:0.0:1784938321.002113:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:0.0:1784938321.002123:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13731:x1871643048782592:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1784938321.002895:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13731:x1871643048782592:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 314us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938321.002907:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:0.0:1784938321.008905:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938321.009019:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782720 00000100:00100000:1.0:1784938321.009033:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782720 00000100:00100000:1.0:1784938321.009209:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:1.0:1784938321.009267:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13731:x1871643048782720:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1784938321.009575:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13731:x1871643048782720:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 310us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938321.009584:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1784938321.029310:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938321.029476:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782848 00000100:00100000:1.0:1784938321.029489:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782848 00000100:00100000:1.0:1784938321.029555:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784938321.029567:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2354:x1871643048782848:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:1.0:1784938321.029611:0:15342:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from fab6306c-39cb-46f6-95e0-7a5423945d94@192.168.201.58@tcp t0 exp 0000000000000000 cur 529 last 0 00000020:00000080:1.0:1784938321.030276:0:15342:0:(genops.c:1406:class_connect()) connect: client fab6306c-39cb-46f6-95e0-7a5423945d94, cookie 0xea86628a8aec4ab7 00000004:00100000:1.0:1784938321.030313:0:15342:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1784938321.030320:0:15342:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1784938321.079856:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1784938321.103622:0:15342:0:(import.c:65:import_set_state_nolock()) ffffa059c1381800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938321.103736:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1085880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2354:x1871643048782848:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 74169us (74440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938321.103750:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1784938321.109678:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938321.109842:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783104 00000100:00100000:2.0:1784938321.109869:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783104 00000100:00100000:2.0:1784938321.109954:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:2.0:1784938321.109967:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13707:x1871643048783104:12345-192.168.201.58@tcp:41:mount.lustre.0 00000100:00080000:0.0:1784938321.110167:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938321.113439:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938321.113914:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048782976 00000100:00100000:1.0:1784938321.113928:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048782976 00000100:00100000:1.0:1784938321.114000:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784938321.114027:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:0:x1871643048782976:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1784938321.114085:0:14288:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1784938321.114203:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:0:x1871643048782976:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 178us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938321.114288:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000004:00000024:0.0:1784938321.116233:0:14290:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784938321.116425:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13707:x1871643048783104:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 6456us (6754us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938321.116444:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:2.0:1784938321.121926:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938321.123494:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783232 00000100:00100000:3.0:1784938321.123511:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783232 00000100:00100000:3.0:1784938321.123601:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1784938321.123611:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13707:x1871643048783232:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:3.0:1784938321.123727:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13707:x1871643048783232:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 116us (1809us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938321.123735:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784938321.126805:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938321.126847:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938321.126878:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938321.127001:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783360 00000100:00100000:1.0:1784938321.127012:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783360 00000100:00100000:1.0:1784938321.127071:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783488 00000100:00100000:1.0:1784938321.127074:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783488 00000100:00100000:1.0:1784938321.127098:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938321.127107:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1871643048783360:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938321.127140:0:14925:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from fab6306c-39cb-46f6-95e0-7a5423945d94@192.168.201.58@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1784938321.127178:0:14925:0:(genops.c:1406:class_connect()) connect: client fab6306c-39cb-46f6-95e0-7a5423945d94, cookie 0xea86628a8aec4abe 00002000:00100000:1.0:1784938321.127191:0:14925:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli fab6306c-39cb-46f6-95e0-7a5423945d94/ffffa05ac9b4f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938321.127255:0:14925:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938321.127706:0:14925:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1784938321.127741:0:14925:0:(import.c:65:import_set_state_nolock()) ffffa05ac9b4c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938321.127819:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2354:x1871643048783360:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 711us (1023us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938321.127828:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938321.127852:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938321.127856:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1871643048783488:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938321.127873:0:14925:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from fab6306c-39cb-46f6-95e0-7a5423945d94@192.168.201.58@tcp t0 exp 0000000000000000 cur 530 last 0 00000020:00000080:1.0:1784938321.127898:0:14925:0:(genops.c:1406:class_connect()) connect: client fab6306c-39cb-46f6-95e0-7a5423945d94, cookie 0xea86628a8aec4ac5 00002000:00100000:1.0:1784938321.127904:0:14925:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli fab6306c-39cb-46f6-95e0-7a5423945d94/ffffa05ac9b4a800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938321.127922:0:14925:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938321.128138:0:14925:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938321.128158:0:14925:0:(import.c:65:import_set_state_nolock()) ffffa05aefb7f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938321.128203:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2354:x1871643048783488:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 345us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938321.128209:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1784938321.128935:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783616 00000100:00100000:3.0:1784938321.128946:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783616 00000100:00100000:3.0:1784938321.128999:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784938321.129009:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13707:x1871643048783616:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00080000:3.0:1784938321.133369:0:14291:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4226us 00000004:00200000:3.0:1784938321.166802:0:14291:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1784938321.167055:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13707:x1871643048783616:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 38038us (40196us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938321.167069:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784938321.401430:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938321.401593:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783744 00000100:00100000:2.0:1784938321.401605:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783744 00000100:00100000:2.0:1784938321.401670:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1784938321.401680:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13752:x1871643048783744:12345-192.168.201.58@tcp:101:mkdir.0 00010000:00010000:2.0:1784938321.401703:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938321.401731:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4acc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897ca7 expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938321.401819:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4ad3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938321.401835:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938321.401851:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938321.402085:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938321.402090:0:15342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938321.402202:0:15342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938321.402267:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ca7 expref: 8 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938321.402297:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ca7 expref: 7 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938321.402306:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938321.402309:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938321.402313:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938321.402394:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+7:13752:x1871643048783744:12345-192.168.201.58@tcp:101:mkdir.0 Request processed in 715us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938321.402401:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00010000:00010000:3.0:1784938322.098132:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938323.123003:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938323.488810:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938323.488919:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048783872 00000100:00100000:3.0:1784938323.488931:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048783872 00000100:00080000:0.0:1784938323.489097:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938323.489162:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1784938323.489178:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+7:13804:x1871643048783872:12345-192.168.201.58@tcp:41:lfs.0 00000004:00000024:3.0:1784938323.489284:0:14289:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1784938323.489636:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+7:13804:x1871643048783872:12345-192.168.201.58@tcp:41:lfs.0 Request processed in 461us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.489646:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1784938323.505728:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065556352:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:0.0:1784938323.506306:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938323.506611:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556352 00000100:00100000:1.0:1784938323.506621:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556352 00000100:00100000:1.0:1784938323.506702:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:1.0:1784938323.506715:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065556352:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938323.506762:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938323.506817:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065556352:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 105us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938323.506827:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:2.0:1784938323.507066:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065556352:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938323.507483:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938323.507554:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784000 00000100:00100000:3.0:1784938323.507561:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784000 00000100:00100000:3.0:1784938323.507595:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1784938323.507603:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13804:x1871643048784000:12345-192.168.201.58@tcp:13:lfs.0 00002000:00000024:3.0:1784938323.507620:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938323.507693:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13804:x1871643048784000:12345-192.168.201.58@tcp:13:lfs.0 Request processed in 90us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.507721:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00080000:0.0:1784938323.507794:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938323.510863:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938323.510975:0:14927:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784128 00000100:00100000:3.0:1784938323.510989:0:14927:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784128 00000100:00100000:3.0:1784938323.511086:0:14927:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1784938323.511098:0:14927:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13804:x1871643048784128:12345-192.168.201.58@tcp:13:lfs.0 00002000:00000024:3.0:1784938323.511139:0:14927:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1784938323.511335:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1784938323.511858:0:14927:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:fab6306c-39cb-46f6-95e0-7a5423945d94+6:13804:x1871643048784128:12345-192.168.201.58@tcp:13:lfs.0 Request processed in 760us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.511867:0:14927:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1784938323.736284:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938323.736445:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784256 00000100:00100000:1.0:1784938323.736468:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784256 00000100:00100000:1.0:1784938323.736563:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:1.0:1784938323.736576:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+10:13835:x1871643048784256:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1784938323.736599:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938323.736625:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991400/0xea86628a8aec4ada lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897cae expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938323.736672:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991400/0xea86628a8aec4ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cae expref: 11 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938323.736688:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991400/0xea86628a8aec4ada lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cae expref: 11 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938323.736699:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991400, rc 0) 00000100:00100000:1.0:1784938323.736803:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13835:x1871643048784256:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 229us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938323.736811:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:1.0:1784938323.755906:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938323.758316:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784384 00000100:00100000:0.0:1784938323.758341:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784384 00000100:00100000:0.0:1784938323.758539:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:0.0:1784938323.758553:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13835:x1871643048784384:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784938323.759084:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13835:x1871643048784384:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 532us (3191us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938323.759096:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:2.0:1784938323.762025:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938323.782860:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784512 00000100:00100000:1.0:1784938323.782882:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784512 00000100:00100000:3.0:1784938323.783210:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1784938323.783262:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13835:x1871643048784512:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1784938323.783680:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13835:x1871643048784512:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 421us (21675us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.783690:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:2.0:1784938323.802782:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938323.803076:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784640 00000100:00100000:3.0:1784938323.803090:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784640 00000100:00100000:3.0:1784938323.803174:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:3.0:1784938323.803187:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13843:x1871643048784640:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938323.803771:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13843:x1871643048784640:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 584us (1003us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.803781:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:1.0:1784938323.856130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.856261:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784768 00000100:00100000:2.0:1784938323.856276:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784768 00000100:00100000:2.0:1784938323.856381:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:2.0:1784938323.856394:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13843:x1871643048784768:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938323.856804:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13843:x1871643048784768:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 410us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.856824:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:3.0:1784938323.869702:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938323.870008:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048784896 00000100:00100000:0.0:1784938323.870026:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048784896 00000100:00100000:0.0:1784938323.870119:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:0.0:1784938323.870134:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13835:x1871643048784896:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1784938323.870161:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938323.870194:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac6837c00/0xea86628a8aec4ae1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897cd8 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938323.870292:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac6837c00/0xea86628a8aec4ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cd8 expref: 12 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938323.870317:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac6837c00/0xea86628a8aec4ae1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cd8 expref: 12 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938323.870328:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6837c00, rc 0) 00000100:00100000:0.0:1784938323.870413:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4153c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13835:x1871643048784896:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 283us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938323.870420:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:3.0:1784938323.875701:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938323.875891:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785024 00000100:00100000:0.0:1784938323.875906:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785024 00000100:00100000:0.0:1784938323.876001:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:0.0:1784938323.876015:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13835:x1871643048785024:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1784938323.876062:0:14282:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1784938323.876109:0:14282:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1784938323.876115:0:14282:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1784938323.876118:0:14282:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1784938323.876121:0:14282:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1784938323.879402:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13835:x1871643048785024:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 3360us (3692us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938323.879423:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:1.0:1784938323.893194:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.893399:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785152 00000100:00100000:2.0:1784938323.893415:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785152 00000100:00100000:2.0:1784938323.893496:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:2.0:1784938323.893510:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13835:x1871643048785152:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1784938323.893539:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938323.893569:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897cdf expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938323.893725:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938323.893740:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 13 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938323.893752:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892000, rc 0) 00000100:00100000:2.0:1784938323.893842:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4151850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13835:x1871643048785152:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 334us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.893851:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:3.0:1784938323.898892:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938323.899123:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785280 00000100:00100000:0.0:1784938323.899141:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785280 00000100:00100000:0.0:1784938323.899268:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:0.0:1784938323.899280:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13835:x1871643048785280:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1784938323.899719:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4150050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13835:x1871643048785280:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 440us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938323.899729:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:1.0:1784938323.902945:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.903304:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785408 00000100:00100000:2.0:1784938323.903330:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785408 00000100:00100000:2.0:1784938323.903431:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:2.0:1784938323.903446:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13835:x1871643048785408:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1784938323.904082:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4152c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13835:x1871643048785408:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 637us (1150us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.904093:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:1.0:1784938323.906913:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938323.907440:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785536 00000100:00100000:3.0:1784938323.907456:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785536 00000100:00100000:3.0:1784938323.907547:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:3.0:1784938323.907560:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13848:x1871643048785536:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1784938323.907944:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13848:x1871643048785536:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 385us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938323.907953:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:3.0:1784938323.914162:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.922897:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785664 00000100:00100000:2.0:1784938323.922925:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785664 00000100:00100000:2.0:1784938323.923034:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1784938323.923049:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13848:x1871643048785664:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1784938323.923516:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13848:x1871643048785664:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 468us (9375us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.923526:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:1.0:1784938323.936372:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.936815:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785792 00000100:00100000:2.0:1784938323.936830:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785792 00000100:00100000:2.0:1784938323.936896:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1784938323.936908:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2354:x1871643048785792:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1784938323.936954:0:15342:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-MDT0000: connection from 8cedbaae-217c-4297-ba4f-37266cedd843@192.168.201.58@tcp t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:2.0:1784938323.937007:0:15342:0:(genops.c:1406:class_connect()) connect: client 8cedbaae-217c-4297-ba4f-37266cedd843, cookie 0xea86628a8aec4aef 00000004:00100000:2.0:1784938323.937055:0:15342:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1784938323.937261:0:15342:0:(import.c:65:import_set_state_nolock()) ffffa059c1382800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1784938323.937575:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2354:x1871643048785792:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 665us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.937586:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938323.960945:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.961579:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786048 00000100:00100000:2.0:1784938323.961599:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786048 00000100:00100000:2.0:1784938323.961722:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938323.961735:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:13835:x1871643048786048:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:2.0:1784938323.961786:0:14289:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1784938323.962051:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938323.962132:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:13835:x1871643048786048:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 398us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.962165:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938323.966462:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938323.967051:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048785920 00000100:00100000:0.0:1784938323.967065:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048785920 00000100:00100000:0.0:1784938323.967158:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1784938323.967173:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+6:0:x1871643048785920:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1784938323.967272:0:14290:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1784938323.967403:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+6:0:x1871643048785920:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 234us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938323.967413:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784938323.974383:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938323.974542:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786176 00000100:00100000:1.0:1784938323.974559:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786176 00000100:00100000:1.0:1784938323.974659:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938323.974673:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cedbaae-217c-4297-ba4f-37266cedd843+6:13835:x1871643048786176:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:1.0:1784938323.974820:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1084a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cedbaae-217c-4297-ba4f-37266cedd843+6:13835:x1871643048786176:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 150us (457us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938323.974828:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938323.977641:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938323.977694:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938323.977746:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938323.977852:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786304 00000100:00100000:2.0:1784938323.977866:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786304 00000100:00100000:2.0:1784938323.977927:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786432 00000100:00100000:2.0:1784938323.977930:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786432 00000100:00100000:2.0:1784938323.977951:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938323.977962:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2354:x1871643048786304:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1784938323.978023:0:14925:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0000: connection from 8cedbaae-217c-4297-ba4f-37266cedd843@192.168.201.58@tcp t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:2.0:1784938323.978071:0:14925:0:(genops.c:1406:class_connect()) connect: client 8cedbaae-217c-4297-ba4f-37266cedd843, cookie 0xea86628a8aec4af6 00002000:00100000:2.0:1784938323.978090:0:14925:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8cedbaae-217c-4297-ba4f-37266cedd843/ffffa059c1386800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1784938323.978105:0:14925:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1784938323.978301:0:14925:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1784938323.978354:0:14925:0:(import.c:65:import_set_state_nolock()) ffffa059c1384000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938323.978530:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1784938323.978536:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2354:x1871643048786432:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1784938323.978556:0:14926:0:(ldlm_lib.c:1468:target_handle_connect()) lustre-OST0001: connection from 8cedbaae-217c-4297-ba4f-37266cedd843@192.168.201.58@tcp t0 exp 0000000000000000 cur 532 last 0 00000020:00000080:1.0:1784938323.978585:0:14926:0:(genops.c:1406:class_connect()) connect: client 8cedbaae-217c-4297-ba4f-37266cedd843, cookie 0xea86628a8aec4afd 00002000:00100000:1.0:1784938323.978614:0:14926:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8cedbaae-217c-4297-ba4f-37266cedd843/ffffa05aefb7d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136cb ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1784938323.978623:0:14926:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1784938323.978694:0:14926:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1784938323.978711:0:14926:0:(import.c:65:import_set_state_nolock()) ffffa05aefb7c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1784938323.978784:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+6:2354:x1871643048786432:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 245us (1035us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938323.978793:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1784938323.979544:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:2354:x1871643048786304:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 1580us (1913us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938323.979554:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1784938323.980203:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786560 00000100:00100000:0.0:1784938323.980245:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786560 00000100:00100000:0.0:1784938323.980299:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784938323.980321:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:13835:x1871643048786560:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00200000:0.0:1784938323.980734:0:14292:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1784938323.980884:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:13835:x1871643048786560:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 575us (3187us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938323.980893:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:1.0:1784938324.142899:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938324.143147:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786688 00000100:00100000:0.0:1784938324.143164:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786688 00000100:00100000:0.0:1784938324.143387:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938324.143402:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+6:13869:x1871643048786688:12345-192.168.201.58@tcp:101:mkdir.0 00010000:00010000:0.0:1784938324.143436:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938324.143475:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4b04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d09 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938324.143583:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938324.143620:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938324.143638:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938324.143944:0:14290:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1784938324.143950:0:14290:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938324.144200:0:14290:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938324.144267:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4b04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 8 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938324.144312:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 7 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938324.144324:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:0.0:1784938324.144328:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938324.144333:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6836e00, rc 0) 00000100:00100000:0.0:1784938324.144441:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+7:13869:x1871643048786688:12345-192.168.201.58@tcp:101:mkdir.0 Request processed in 1042us (1559us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938324.144451:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:3.0:1784938324.149905:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938325.041779:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065556736:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.041960:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938325.041967:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065556864:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.042265:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938325.042365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938325.042400:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556736 00000100:00100000:1.0:1784938325.042410:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556736 00000100:00100000:1.0:1784938325.042493:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:1.0:1784938325.042504:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065556736:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.042570:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065556736:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 68us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938325.042579:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 5 00000100:00100000:1.0:1784938325.042607:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556864 00000100:00100000:1.0:1784938325.042610:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556864 00000100:00100000:1.0:1784938325.042637:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00100000:1.0:1784938325.042643:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c3548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065556864:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.042670:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c3548700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065556864:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938325.042694:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 16 00000100:00080000:1.0:1784938325.042711:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1784938325.042835:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065556864:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.042846:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1784938325.042868:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065556736:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938325.043105:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3323:1871643065556480:0@lo:400:kworker.0 00000100:00100000:0.0:1784938325.043154:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938325.043194:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065556992:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938325.043247:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1784938325.043254:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065556608:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938325.043279:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065557120:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.045783:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556480 00000100:00100000:1.0:1784938325.045804:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556480 00000100:00100000:1.0:1784938325.046063:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784938325.046076:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3323:x1871643065556480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938325.046235:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3323:x1871643065556480:12345-0@lo:400:kworker.0 Request processed in 139us (3055us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938325.046245:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1784938325.046527:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938325.046557:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938325.046580:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:0.0:1784938325.046904:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3323:1871643065556480:0@lo:400:kworker.0 00000100:00100000:0.0:1784938325.047326:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556608 00000100:00100000:0.0:1784938325.047334:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556608 00000100:00100000:0.0:1784938325.047401:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:0.0:1784938325.047410:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065556608:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938325.047479:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065556608:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 71us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938325.047506:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 6 00000100:00100000:0.0:1784938325.047659:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065556608:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.048470:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065556992 00000100:00100000:1.0:1784938325.048479:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065556992 00000100:00100000:1.0:1784938325.048518:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557120 00000100:00100000:1.0:1784938325.048521:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557120 00000100:00100000:1.0:1784938325.048546:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:1.0:1784938325.048554:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065556992:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.050168:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1871643065556992:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 1601us (3631us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938325.050181:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:1.0:1784938325.050230:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00100000:1.0:1784938325.050254:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065557120:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.050329:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065557120:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 78us (3748us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938325.050336:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00080000:1.0:1784938325.050367:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938325.050388:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938325.055877:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938325.055915:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065557248:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938325.056263:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938325.056310:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557248 00000100:00100000:1.0:1784938325.056321:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557248 00000100:00100000:1.0:1784938325.056409:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:1.0:1784938325.056422:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065557248:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938325.056463:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938325.056518:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065557248:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938325.056528:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 9 00000100:00100000:1.0:1784938325.058854:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065557120:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938325.058882:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c354b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3323:1871643065556992:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938325.059454:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ac822df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065557248:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:3.0:1784938325.175056:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1784938325.188342:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8cedbaae-217c-4297-ba4f-37266cedd843 00000001:00100000:0.0:1784938325.188372:0:7507:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of fab6306c-39cb-46f6-95e0-7a5423945d94 00000001:00100000:1.0:1784938325.202898:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of fab6306c-39cb-46f6-95e0-7a5423945d94 00000001:00100000:1.0:1784938325.202927:0:6628:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8cedbaae-217c-4297-ba4f-37266cedd843 00000001:00100000:2.0:1784938326.158127:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8cedbaae-217c-4297-ba4f-37266cedd843 00000001:00100000:2.0:1784938326.158152:0:5828:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of fab6306c-39cb-46f6-95e0-7a5423945d94 00010000:00010000:3.0:1784938326.193557:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1784938327.218775:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1784938327.705750:0:16152:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1784938328.241861:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938328.635685:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1784938328.635720:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065557376:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938328.636189:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938328.636338:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557376 00000100:00100000:3.0:1784938328.636349:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557376 00000100:00100000:3.0:1784938328.636434:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00100000:3.0:1784938328.636447:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065557376:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938328.636497:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938328.636558:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1086680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065557376:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 113us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938328.636567:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 10 00000100:00080000:1.0:1784938328.636737:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938328.636884:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065557376:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:1.0:1784938329.013523:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014183:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014258:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014284:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014305:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014325:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014349:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938329.014386:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787072 00000100:00100000:1.0:1784938329.014399:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787072 00000100:00100000:1.0:1784938329.014471:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787584 00000100:00100000:1.0:1784938329.014473:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787584 00000100:00100000:1.0:1784938329.014486:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787200 00000100:00100000:1.0:1784938329.014488:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787200 00000100:00100000:1.0:1784938329.014498:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787456 00000100:00100000:1.0:1784938329.014500:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787456 00000100:00100000:1.0:1784938329.014515:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784938329.014526:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2356:x1871643048787072:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938329.014622:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2356:x1871643048787072:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 97us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.014630:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784938329.014649:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1784938329.014655:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2356:x1871643048787584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938329.014682:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2356:x1871643048787584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.014688:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1784938329.014699:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938329.014704:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2355:x1871643048787200:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938329.014725:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2355:x1871643048787200:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.014746:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938329.014757:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938329.014763:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2355:x1871643048787456:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938329.014787:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2355:x1871643048787456:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.014794:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1784938329.014814:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787328 00000100:00100000:1.0:1784938329.014817:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787328 00000100:00100000:1.0:1784938329.014845:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786944 00000100:00100000:1.0:1784938329.014848:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786944 00000100:00100000:1.0:1784938329.014870:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938329.014876:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c354b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2356:x1871643048787328:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938329.014904:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c354b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2356:x1871643048787328:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.014910:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1784938329.014921:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1784938329.014926:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2355:x1871643048786944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938329.014948:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2355:x1871643048786944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 22us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938329.014955:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00080000:1.0:1784938329.014997:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1784938329.015002:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938329.015004:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1784938329.020493:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048786816 00000100:00100000:0.0:1784938329.020518:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048786816 00000100:00100000:0.0:1784938329.020599:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:0.0:1784938329.020612:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2356:x1871643048786816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938329.020720:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2356:x1871643048786816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 111us (7209us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938329.020728:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 105 00010000:00010000:2.0:1784938329.266151:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1784938330.035962:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1784938330.161561:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065557632:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.161748:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065558144:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.161797:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1784938330.161804:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065557504:0@lo:400:kworker.0 00000100:00100000:1.0:1784938330.161868:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938330.161911:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065558016:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.161952:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065557760:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.161981:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1784938330.161987:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065557888:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.162320:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938330.162380:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938330.162405:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938330.162431:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938330.162454:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938330.162491:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557504 00000100:00100000:1.0:1784938330.162502:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557504 00000100:00100000:1.0:1784938330.162568:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784938330.162581:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3324:x1871643065557504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938330.162654:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3324:x1871643065557504:12345-0@lo:400:kworker.0 Request processed in 75us (785us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.162663:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1784938330.162712:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065558144 00000100:00100000:1.0:1784938330.162716:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065558144 00000100:00100000:1.0:1784938330.162761:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065558016 00000100:00100000:1.0:1784938330.162764:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065558016 00000100:00100000:1.0:1784938330.162780:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557888 00000100:00100000:1.0:1784938330.162797:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557888 00000100:00100000:1.0:1784938330.162822:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00100000:1.0:1784938330.162830:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065558144:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.162873:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1871643065558144:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 44us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.162879:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 21 00000100:00100000:1.0:1784938330.162896:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:1.0:1784938330.162904:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065558016:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.162930:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1871643065558016:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.162936:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 22 00000100:00100000:1.0:1784938330.162948:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 23 00000100:00100000:1.0:1784938330.162954:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065557888:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.162976:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065557888:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 22us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.162981:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 23 00000100:00100000:1.0:1784938330.163001:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557760 00000100:00100000:1.0:1784938330.163004:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557760 00000100:00100000:1.0:1784938330.163044:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065557632 00000100:00100000:1.0:1784938330.163047:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065557632 00000100:00100000:1.0:1784938330.163074:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:1.0:1784938330.163080:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065557760:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.163107:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3321:x1871643065557760:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 26us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.163113:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:1.0:1784938330.163136:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:1.0:1784938330.163143:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065557632:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.163169:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065557632:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 26us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.163175:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00080000:1.0:1784938330.163249:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1784938330.163254:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1784938330.163257:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1784938330.163457:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065557888:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.163473:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3321:1871643065557760:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.163514:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065557504:0@lo:400:kworker.0 00000100:00100000:1.0:1784938330.163528:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3324:1871643065558016:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.163539:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065557632:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.163550:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3324:1871643065558144:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938330.167726:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1784938330.167777:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065558272:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:1.0:1784938330.168153:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938330.169866:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065558272 00000100:00100000:1.0:1784938330.169884:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065558272 00000100:00100000:1.0:1784938330.169973:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:1.0:1784938330.169986:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065558272:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:1.0:1784938330.170039:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938330.170143:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065558272:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 158us (1991us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938330.170163:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 11 00000100:00100000:2.0:1784938330.178899:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065558272:192.168.201.158@tcp:13:osp-pre-1-0.0 00010000:00010000:2.0:1784938330.291359:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938331.316784:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1784938331.382649:0:16299:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe213c7ee0 20000000:00000080:3.0:1784938331.382668:0:16299:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffffa059c2808800 uarg=0000000000000000 20000000:01000000:3.0:1784938331.382718:0:16299:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784938331.382731:0:16299:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1784938331.382736:0:16299:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1784938331.386337:0:16300:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1784938331.386710:0:16299:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1784938331.397529:0:16299:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1784938331.397566:0:16299:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.397589:0:16299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4802 expref: 18 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.397596:0:16299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.397602:0:16299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec498a expref: 18 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398527:0:16299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 12 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398563:0:16299:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398571:0:16299:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398616:0:16299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398630:0:16299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 12 pid: 14283 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.398645:0:16299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558400:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938331.398756:0:16299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 12 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398764:0:16299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 12 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.398771:0:16299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558528:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938331.398798:0:16299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec498a expref: 18 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.398805:0:16299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec498a expref: 18 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.398814:0:16299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558656:0@lo:104: 00000100:00100000:0.0:1784938331.398929:0:16299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1784938331.399047:0:16299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.399056:0:16299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.399064:0:16299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558784:0@lo:104: 00000100:00100000:0.0:1784938331.399091:0:16299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938331.399140:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065558656 00000100:00100000:0.0:1784938331.399148:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065558656 00000100:00100000:0.0:1784938331.399196:0:14272:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065558784 00000100:00100000:0.0:1784938331.399199:0:14272:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065558784 00000100:00100000:0.0:1784938331.399248:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938331.399257:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05affeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+4:16299:x1871643065558656:12345-0@lo:104: 00010000:00010000:0.0:1784938331.399407:0:14272:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.403245:0:14272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1784938331.403273:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05affeb7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+4:16299:x1871643065558656:12345-0@lo:104: Request processed in 4002us (4330us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.403285:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938331.403329:0:14272:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1784938331.403343:0:14272:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:16299:x1871643065558784:12345-0@lo:104: 00010000:00010000:0.0:1784938331.403359:0:14272:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403744:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1784938331.403753:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403762:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938331.403766:0:15346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403775:0:15346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938331.403783:0:15346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938331.403789:0:15346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938331.403825:0:15346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403831:0:15346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938331.403933:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403949:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87d600/0xea86628a8aec498a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4991 expref: -99 pid: 15593 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403964:0:15346:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938331.403967:0:15346:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.403991:0:15346:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc1de7c20) 00010000:00010000:0.0:1784938331.404093:0:14272:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:0.0:1784938331.404102:0:14272:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:16299:x1871643065558784:12345-0@lo:104: Request processed in 764us (5008us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.404119:0:14272:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1784938331.404175:0:16299:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xea86628a8aec4802 expref: 18 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.404199:0:16299:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xea86628a8aec4802 expref: 18 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.404234:0:16299:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff881c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065559040:0@lo:104: 00000100:00100000:0.0:1784938331.404290:0:16299:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938331.404317:0:16299:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac6860a80 going to sleep for 11 seconds 00000100:00100000:0.0:1784938331.404339:0:16299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558656:0@lo:104: 00000100:00100000:0.0:1784938331.404347:0:16299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb4a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558784:0@lo:104: 00000100:00100000:0.0:1784938331.404514:0:3321:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1784938331.404527:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3321:1871643065558912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1784938331.404556:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938331.404718:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938331.405431:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938331.405468:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065558912 00000100:00100000:0.0:1784938331.405476:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065558912 00010000:00010000:0.0:1784938331.405512:0:14275:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec498a expref: 19 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.405535:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787712 00000100:00100000:0.0:1784938331.405538:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787712 00010000:00010000:0.0:1784938331.405557:0:14275:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 13 pid: 14283 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.405576:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787840 00000100:00100000:0.0:1784938331.405599:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787840 00010000:00010000:2.0:1784938331.405614:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:3.0:1784938331.406134:0:15346:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.406159:0:15346:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938331.406172:0:15346:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938331.406194:0:15346:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1784938331.406489:0:14275:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 14 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.406534:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938331.406546:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3321:x1871643065558912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938331.406571:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938331.406580:0:14275:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec498a expref: 19 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.406594:0:14275:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec498a expref: 19 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.406828:0:15346:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.406839:0:15346:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938331.407109:0:15346:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.407119:0:15346:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87d200/0xea86628a8aec484f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4856 expref: -99 pid: 14922 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.407143:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938331.407146:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938331.407149:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938331.407201:0:14274:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1784938331.407255:0:14274:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1784938331.407428:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4991 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec498a expref: 19 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.407448:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938331.407549:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:3321:x1871643065558912:12345-0@lo:103:ldlm_bl.0 Request processed in 1004us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.407562:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1784938331.407597:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784938331.408069:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3323:1871643065559168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938331.408116:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938331.408431:0:16299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558400:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938331.408444:0:16299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05affeb5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065558528:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938331.408511:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+14:2355:x1871643048787712:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938331.408531:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938331.408538:0:14275:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 14 pid: 14283 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408551:0:14275:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 14 pid: 14283 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408590:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05afc892000/0xea86628a8aec4ae8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897cdf expref: 14 pid: 14283 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408602:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938331.408674:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2355:x1871643048787712:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1067us (3957us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.408682:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1784938331.408701:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559168 00000100:00100000:0.0:1784938331.408708:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559168 00010000:00010000:0.0:1784938331.408727:0:14275:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938331.408745:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784938331.408752:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afff23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:2355:x1871643048787840:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938331.408760:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938331.408765:0:14275:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 12 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408773:0:14275:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 12 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408783:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac6837200/0xea86628a8aec4ab0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897c7d expref: 12 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408793:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938331.408812:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afff23050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:2355:x1871643048787840:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 61us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.408828:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784938331.408882:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1784938331.408888:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:3323:x1871643065559168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1784938331.408897:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938331.408901:0:14275:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408910:0:14275:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408920:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4856 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec484f expref: 18 pid: 14280 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938331.408929:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938331.409062:0:14271:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1784938331.409076:0:14271:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559040 00000100:00100000:3.0:1784938331.409079:0:14271:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559040 00000100:00100000:3.0:1784938331.409118:0:14271:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1784938331.409124:0:14271:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afb489c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:16299:x1871643065559040:12345-0@lo:104: 00010000:00010000:3.0:1784938331.409139:0:14271:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.409203:0:14271:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1784938331.409209:0:14271:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afb489c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+3:16299:x1871643065559040:12345-0@lo:104: Request processed in 85us (4919us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938331.409238:0:14271:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1784938331.409480:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1784938331.409487:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.409495:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c600 already unused, calling callback (ffffffffc1de7c20) 10000000:00010000:3.0:1784938331.409500:0:14277:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.409510:0:14277:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1784938331.409517:0:14277:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1784938331.409523:0:14277:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1784938331.409570:0:14277:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.409576:0:14277:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1784938331.409591:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938331.409665:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065559296:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1784938331.409705:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938331.410467:0:16299:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff881c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16299:1871643065559040:0@lo:104: 00010000:00010000:1.0:1784938331.410523:0:16299:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.412544:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffffa05aff87c600/0xea86628a8aec4802 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xea86628a8aec4809 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938331.412585:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938331.412588:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938331.412593:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938331.412865:0:14273:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1784938331.412894:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559296 00000100:00100000:1.0:1784938331.412906:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559296 00000100:00100000:0.0:1784938331.413419:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:3323:x1871643065559168:12345-0@lo:103:ldlm_bl.0 Request processed in 4520us (5292us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938331.413434:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1784938331.413575:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3323:1871643065559168:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938331.414186:0:14273:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec4802 expref: 17 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.414537:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938331.414556:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:3324:x1871643065559296:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1784938331.414578:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938331.414587:0:14273:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xea86628a8aec4802 expref: 17 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414602:0:14273:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xea86628a8aec4802 expref: 17 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414623:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac0030200/0xea86628a8aec4809 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xea86628a8aec4802 expref: 17 pid: 14282 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414666:0:14273:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414677:0:14273:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414696:0:14273:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414705:0:14273:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414713:0:14273:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414721:0:14273:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414728:0:14273:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938331.414733:0:14273:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414742:0:14273:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414767:0:14273:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938331.414778:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938331.414816:0:16299:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938331.414826:0:16299:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938331.414886:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1086d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:3324:x1871643065559296:12345-0@lo:103:ldlm_bl.0 Request processed in 334us (5177us total) trans 0 rc 0/0 00010000:00010000:2.0:1784938331.414960:0:16299:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffffa05ac6837400/0xea86628a8aec4b12 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16299 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938331.415141:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3321:1871643065558912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1784938331.415459:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1784938331.415501:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3324:1871643065559296:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1784938332.340996:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1784938332.724284:0:14285:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938332.724291:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05afc8a4000 from 10 10000000:01000000:0.0:1784938332.724296:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938332.724339:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.724351:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.724361:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.724397:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff880e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.724516:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938332.724592:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a376c0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938332.726737:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559424 00000100:00100000:2.0:1784938332.726752:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559424 00000100:00100000:2.0:1784938332.726827:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784938332.726838:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+16:14285:x1871643065559424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938332.726857:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938332.726877:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05afc892600/0xea86628a8aec4b20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4b19 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.726907:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05afc892600/0xea86628a8aec4b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4b19 expref: 17 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.726918:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05afc892600/0xea86628a8aec4b20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4b19 expref: 17 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.726928:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892600, rc 0) 00000100:00100000:2.0:1784938332.727017:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:14285:x1871643065559424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2499us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938332.727025:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1784938332.727088:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff880e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1784938332.727106:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b20 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938332.727116:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4b20 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938332.727199:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938332.727301:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938332.727324:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938332.727335:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559552 00000100:00100000:2.0:1784938332.727337:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559552 00000100:00100000:2.0:1784938332.727354:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784938332.727358:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:14285:x1871643065559552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938332.727622:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:14285:x1871643065559552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938332.727630:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1784938332.727659:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938332.727687:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938332.727725:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1784938332.727738:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05b01ed6cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1784938332.727749:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559680 00000100:00100000:2.0:1784938332.727752:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559680 00000100:00100000:2.0:1784938332.727775:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784938332.727780:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:14285:x1871643065559680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1784938332.727934:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:14285:x1871643065559680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 153us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938332.727940:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1784938332.727974:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1784938332.740517:0:16350:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784938332.740946:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784938332.741042:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938332.741057:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b20 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.741071:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac6836c00/0xea86628a8aec4b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b20 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938332.741082:0:14285:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938332.741084:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05afb438000 from 10 10000000:01000000:0.0:1784938332.741087:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938332.741128:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.741135:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.741145:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.741181:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.741749:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938332.741793:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a37480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938332.742372:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559808 00000100:00100000:1.0:1784938332.742384:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559808 00000100:00100000:1.0:1784938332.742444:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1784938332.742454:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+17:14285:x1871643065559808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938332.742472:0:14280:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.742500:0:14280:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4b2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4b27 expref: -99 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.742531:0:14280:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4b27 expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.742543:0:14280:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991c00/0xea86628a8aec4b2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4b27 expref: 18 pid: 14280 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.742554:0:14280:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991c00, rc 0) 00000100:00100000:1.0:1784938332.742621:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065559808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.742628:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1784938332.742754:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938332.742771:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b2e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.742789:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4b2e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.742858:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.742890:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938332.742924:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a37480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938332.742962:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065559936 00000100:00100000:1.0:1784938332.742967:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065559936 00000100:00100000:1.0:1784938332.742997:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784938332.743003:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065559936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.747316:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065559936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 4299us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.747332:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff883100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065559936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.747334:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1784938332.747402:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938332.747495:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938332.748016:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560064 00000100:00100000:0.0:1784938332.748025:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560064 00000100:00100000:0.0:1784938332.748118:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784938332.748127:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065560064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.748362:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065560064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938332.748370:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1784938332.748588:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938332.748607:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1784938332.750072:0:16351:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784938332.750361:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784938332.750392:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938332.750406:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b2e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.750418:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac6837800/0xea86628a8aec4b27 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b2e expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1784938332.750441:0:14285:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1784938332.750444:0:14285:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffffa05aff9ff000 from 10 10000000:01000000:0.0:1784938332.750446:0:14285:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1784938332.750503:0:14285:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.750511:0:14285:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.750522:0:14285:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938332.750551:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1784938332.750637:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1784938332.750684:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a37d80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938332.750957:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560192 00000100:00100000:1.0:1784938332.750964:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560192 00000100:00100000:1.0:1784938332.751003:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784938332.751012:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+18:14285:x1871643065560192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938332.751027:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938332.751040:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4b3c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xea86628a8aec4b35 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.751064:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4b3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xea86628a8aec4b35 expref: 19 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.751076:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac8991a00/0xea86628a8aec4b3c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xea86628a8aec4b35 expref: 19 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.751086:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991a00, rc 0) 00000100:00100000:1.0:1784938332.751129:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065560192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.751135:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1784938332.751190:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff882680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1784938332.751204:0:14285:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b3c expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938332.751212:0:14285:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xea86628a8aec4b3c expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938332.751356:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938332.751391:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938332.751406:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938332.751420:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560320 00000100:00100000:1.0:1784938332.751423:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560320 00000100:00100000:1.0:1784938332.751445:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784938332.751451:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065560320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938332.752085:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065560320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 632us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.752096:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1784938332.752144:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1784938332.752191:0:14285:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938332.752374:0:14285:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938332.752391:0:14285:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6600 going to sleep for 11 seconds 00000100:00100000:1.0:1784938332.752405:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560448 00000100:00100000:1.0:1784938332.752409:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560448 00000100:00100000:1.0:1784938332.752429:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1784938332.752436:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065560448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938332.755799:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:14285:x1871643065560448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3352us (3413us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938332.755814:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1784938332.756798:0:14285:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:d8a94b82-749f-4608-8cc0-c15cba2ced0a:14285:1871643065560448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1784938332.758853:0:16352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1784938332.758936:0:14285:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1784938332.758958:0:14285:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1784938332.758969:0:14285:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b3c expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938332.758981:0:14285:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffffa05ac6836800/0xea86628a8aec4b35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xea86628a8aec4b3c expref: -99 pid: 14285 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938333.053146:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938333.054073:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048787968 00000100:00100000:3.0:1784938333.054087:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048787968 00000100:00100000:2.0:1784938333.054676:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:0.0:1784938333.054735:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+11:13722:x1871643048787968:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938333.054758:0:14283:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938333.054783:0:14283:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac6837600/0xea86628a8aec4b43 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d10 expref: -99 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.054909:0:14283:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac6837600/0xea86628a8aec4b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d10 expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.054922:0:14283:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac6837600/0xea86628a8aec4b43 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d10 expref: 12 pid: 14283 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.054934:0:14283:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6837600, rc 0) 00000100:00100000:0.0:1784938333.055017:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13722:x1871643048787968:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 329us (1887us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.055025:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1784938333.056716:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938333.056816:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788096 00000100:00100000:2.0:1784938333.056885:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788096 00000100:00100000:2.0:1784938333.056963:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:2.0:1784938333.056973:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13722:x1871643048788096:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1784938333.058350:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13722:x1871643048788096:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 1370us (1633us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938333.058365:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:2.0:1784938333.063030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938333.063115:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788224 00000100:00100000:0.0:1784938333.063127:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788224 00000100:00100000:0.0:1784938333.063325:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1784938333.063339:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13722:x1871643048788224:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1784938333.063733:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13722:x1871643048788224:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 396us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.063741:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1784938333.070991:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938333.071520:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788352 00000100:00100000:2.0:1784938333.071533:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788352 00000100:00100000:0.0:1784938333.071961:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:0.0:1784938333.071974:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+12:13722:x1871643048788352:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1784938333.071993:0:14282:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938333.072014:0:14282:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffffa05ac6837a00/0xea86628a8aec4b4a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d17 expref: -99 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.072046:0:14282:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffffa05ac6837a00/0xea86628a8aec4b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d17 expref: 13 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.072075:0:14282:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffffa05ac6837a00/0xea86628a8aec4b4a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d17 expref: 13 pid: 14282 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938333.072085:0:14282:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6837a00, rc 0) 00000100:00100000:0.0:1784938333.072193:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13722:x1871643048788352:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 221us (1215us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.072201:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1784938333.074728:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938333.076106:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788480 00000100:00100000:0.0:1784938333.076118:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788480 00000100:00100000:0.0:1784938333.076433:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1784938333.076445:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13722:x1871643048788480:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1784938333.076925:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13722:x1871643048788480:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 481us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938333.076935:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:2.0:1784938333.085489:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938333.085797:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788608 00000100:00100000:1.0:1784938333.085809:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788608 00000100:00100000:1.0:1784938333.085922:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:1.0:1784938333.085933:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05af4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13722:x1871643048788608:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1784938333.086207:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05af4cb2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:13722:x1871643048788608:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 275us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.086269:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00010000:00010000:2.0:1784938333.361500:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1784938333.749003:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1784938333.749034:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa059c1085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065560576:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:2.0:1784938333.749355:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938333.750453:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560576 00000100:00100000:1.0:1784938333.750466:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560576 00000100:00100000:1.0:1784938333.750756:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:1.0:1784938333.750770:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065560576:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:1.0:1784938333.750812:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1784938333.750880:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1085f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065560576:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 112us (1525us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938333.750888:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 12 00000100:00100000:1.0:1784938333.751150:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa059c1085180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065560576:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00080000:2.0:1784938333.751258:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1784938334.146477:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938334.146527:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938334.146563:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938334.146597:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938334.146615:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938334.146635:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938334.146734:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048789248 00000100:00100000:3.0:1784938334.146745:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048789248 00000100:00100000:3.0:1784938334.146806:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788864 00000100:00100000:3.0:1784938334.146809:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788864 00000100:00100000:3.0:1784938334.146831:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1784938334.146839:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2358:x1871643048789248:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938334.146916:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2358:x1871643048789248:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.147028:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1784938334.147047:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1784938334.147055:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2357:x1871643048788864:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938334.147089:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2357:x1871643048788864:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938334.147117:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:1.0:1784938334.148101:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788992 00000100:00100000:1.0:1784938334.148112:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788992 00000100:00100000:1.0:1784938334.148179:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048789504 00000100:00100000:1.0:1784938334.148182:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048789504 00000100:00100000:1.0:1784938334.148197:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048789120 00000100:00100000:1.0:1784938334.148200:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048789120 00000100:00100000:1.0:1784938334.148248:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938334.148257:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2358:x1871643048788992:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938334.148314:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1085180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2358:x1871643048788992:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 59us (1787us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.148321:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938334.148338:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784938334.148344:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2358:x1871643048789504:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938334.148386:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2358:x1871643048789504:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 42us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.148393:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784938334.148403:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1784938334.148410:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2357:x1871643048789120:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938334.148434:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2357:x1871643048789120:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (1797us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.148440:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1784938334.148515:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938334.148651:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048789376 00000100:00100000:1.0:1784938334.148656:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048789376 00000100:00100000:1.0:1784938334.148682:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784938334.148689:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2357:x1871643048789376:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938334.148724:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:2357:x1871643048789376:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 35us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938334.148731:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00080000:2.0:1784938334.149721:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1784938334.149731:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938334.149736:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1784938334.149924:0:14283:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048788736 00000100:00100000:0.0:1784938334.149935:0:14283:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048788736 00000100:00100000:0.0:1784938334.149999:0:14283:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:0.0:1784938334.150009:0:14283:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2358:x1871643048788736:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938334.150097:0:14283:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2358:x1871643048788736:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 78us (3620us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938334.150105:0:14283:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00010000:00010000:3.0:1784938334.385573:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938335.215806:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938335.216178:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048789632 00000100:00100000:3.0:1784938335.216261:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048789632 00000100:00100000:3.0:1784938335.216384:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:3.0:1784938335.216400:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+6:14381:x1871643048789632:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938335.216436:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938335.216473:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4b51 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d1e expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.216602:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.216625:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.216845:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.216870:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.216880:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.216888:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222485:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec4b66 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222587:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222600:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938335.222760:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1784938335.222765:0:15342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938335.222855:0:15342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec4b66 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222869:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222876:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222883:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222890:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938335.222895:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222904:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222916:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:3.0:1784938335.222919:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938335.222923:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222939:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4b58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222953:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222959:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222965:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222970:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938335.222973:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.222979:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.224025:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffffa05ac3861200) 00010000:00010000:3.0:1784938335.224032:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938335.224038:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.224046:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d600/0xea86628a8aec4b5f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.224099:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4b51 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d1e expref: 8 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.224148:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87dc00/0xea86628a8aec4b66 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d1e expref: 7 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.224159:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa05ac3861600) 00010000:00010000:3.0:1784938335.224164:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1784938335.224167:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87dc00, rc 0) 00000100:00100000:3.0:1784938335.224898:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+7:14381:x1871643048789632:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 8497us (9098us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.224910:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1784938335.239483:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938335.244144:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048789888 00000100:00100000:1.0:1784938335.244161:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048789888 00000100:00100000:1.0:1784938335.244443:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784938335.244454:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+7:14381:x1871643048789888:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938335.244475:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938335.244501:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4b6d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d25 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.244601:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.244615:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.244626:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.244897:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.244906:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.244916:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.246823:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec4b82 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.246846:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.246860:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec4b82 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938335.246877:0:14289:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1784938335.247250:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247269:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247276:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247283:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938335.247289:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247299:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247334:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffffa05ac3861600) 00010000:00010000:1.0:1784938335.247338:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938335.247346:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247353:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4b74 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247371:0:14289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247379:0:14289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247386:0:14289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247391:0:14289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938335.247407:0:14289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247415:0:14289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247427:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffffa05ac7d19900) 00010000:00010000:1.0:1784938335.247430:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938335.247434:0:14289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.247442:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4b7b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.253500:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4b6d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d25 expref: 10 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.253592:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990600/0xea86628a8aec4b82 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d25 expref: 9 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.253602:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac7d19500) 00010000:00010000:1.0:1784938335.253605:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938335.253608:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990600, rc 0) 00000100:00100000:1.0:1784938335.253742:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+9:14381:x1871643048789888:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 9288us (14267us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1784938335.253750:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1784938335.277695:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.277761:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938335.277792:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790016 00000100:00100000:1.0:1784938335.277803:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790016 00000100:00100000:2.0:1784938335.277851:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790144 00000100:00100000:2.0:1784938335.277854:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790144 00000100:00100000:1.0:1784938335.277930:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1784938335.285613:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1784938335.285802:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+10:14387:x1871643048790144:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938335.285829:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.285855:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4b90 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d2c expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.285932:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.285947:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.285958:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.285972:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.285979:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286276:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286836:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286845:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286853:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286858:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.286863:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286870:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286883:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938335.286886:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.286890:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286896:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4b97 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286908:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286914:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286926:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286931:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.286933:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286939:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286946:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938335.286948:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.286951:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.286957:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4b9e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938335.287270:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+11:14381:x1871643048790016:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1784938335.287434:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+11:14381:x1871643048790016:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 9491us (9745us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938335.287453:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:1.0:1784938335.287610:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065560704:0@lo:400:kworker.0 00000100:00100000:1.0:1784938335.288082:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1784938335.288155:0:14280:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560704 00000100:00100000:1.0:1784938335.288162:0:14280:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560704 00000100:00100000:1.0:1784938335.288207:0:14280:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1784938335.288235:0:14280:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3322:x1871643065560704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1784938335.288278:0:14280:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:d8a94b82-749f-4608-8cc0-c15cba2ced0a+19:3322:x1871643065560704:12345-0@lo:400:kworker.0 Request processed in 65us (197us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938335.288285:0:14280:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00010000:00010000:2.0:1784938335.288614:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4b90 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d2c expref: 10 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938335.288724:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:d8a94b82-749f-4608-8cc0-c15cba2ced0a:3322:1871643065560704:0@lo:400:kworker.0 00000100:00100000:1.0:1784938335.288779:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065560832:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938335.288853:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065560960:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938335.288913:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065561088:192.168.201.158@tcp:400:kworker.0 00000100:00100000:1.0:1784938335.288962:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065561216:192.168.201.158@tcp:400:kworker.0 00010000:00010000:2.0:1784938335.289899:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:2.0:1784938335.289905:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.289914:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4b90 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d2c expref: 10 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938335.290291:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938335.290460:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938335.290481:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938335.290503:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938335.290536:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065561088 00000100:00100000:3.0:1784938335.290543:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065561088 00000100:00100000:3.0:1784938335.290579:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065561216 00000100:00100000:3.0:1784938335.290582:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065561216 00000100:00100000:3.0:1784938335.290606:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00100000:3.0:1784938335.290614:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065561088:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938335.290668:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1871643065561088:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 55us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.290676:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 26 00000100:00100000:3.0:1784938335.290689:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 27 00000100:00100000:3.0:1784938335.290695:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065561216:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938335.290723:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1871643065561216:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.290742:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 27 00000100:00080000:3.0:1784938335.291048:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1784938335.291072:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560832 00000100:00100000:3.0:1784938335.291076:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560832 00000100:00100000:3.0:1784938335.291106:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065560960 00000100:00100000:3.0:1784938335.291108:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065560960 00000100:00100000:3.0:1784938335.291144:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:3.0:1784938335.291150:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065560832:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938335.291184:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065560832:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 33us (894us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.291190:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 17 00000100:00100000:3.0:1784938335.291204:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00100000:3.0:1784938335.291210:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065560960:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938335.291263:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1871643065560960:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 53us (802us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.291270:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 18 00000100:00080000:3.0:1784938335.291287:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1784938335.291335:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1784938335.291497:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893600, rc 0) 00000100:00100000:2.0:1784938335.291565:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+9:14387:x1871643048790144:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 5935us (13799us total) trans 0 rc 301/301 00000100:00100000:2.0:1784938335.291597:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1784938335.291939:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065560832:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938335.292004:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3324:1871643065560960:192.168.201.158@tcp:400:kworker.0 00000100:00100000:0.0:1784938335.292516:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3322:1871643065561216:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938335.293147:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065561344:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938335.293257:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1784938335.293269:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065561472:192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938335.293487:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938335.293529:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938335.293570:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065561472 00000100:00100000:2.0:1784938335.293578:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065561472 00000100:00100000:2.0:1784938335.293670:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00100000:2.0:1784938335.293683:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065561472:12345-192.168.201.158@tcp:400:kworker.0 00000100:00100000:2.0:1784938335.293743:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1871643065561472:12345-192.168.201.158@tcp:400:kworker.0 Request processed in 63us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938335.293750:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 28 00000100:00080000:2.0:1784938335.293769:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1784938335.293908:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff880a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3323:1871643065561472:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938335.294581:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065561344 00000100:00100000:3.0:1784938335.294588:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065561344 00000100:00100000:3.0:1784938335.294664:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:3.0:1784938335.294672:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065561344:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 00002000:00000024:3.0:1784938335.294710:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1784938335.294760:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1871643065561344:12345-192.168.201.158@tcp:13:osp-pre-1-0.0 Request processed in 89us (1276us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.294767:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 13 00000100:00100000:1.0:1784938335.297525:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3321:1871643065561088:192.168.201.158@tcp:400:kworker.0 00000100:00100000:3.0:1784938335.299587:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff881880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3323:1871643065561344:192.168.201.158@tcp:13:osp-pre-1-0.0 00000100:00100000:2.0:1784938335.304877:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938335.305075:0:14297:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790272 00000100:00100000:1.0:1784938335.305089:0:14297:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790272 00000100:00100000:1.0:1784938335.305181:0:14297:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784938335.305197:0:14297:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fab6306c-39cb-46f6-95e0-7a5423945d94+9:14387:x1871643048790272:12345-192.168.201.58@tcp:700:lfs.0 00000100:00100000:1.0:1784938335.305401:0:14297:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:fab6306c-39cb-46f6-95e0-7a5423945d94+9:14387:x1871643048790272:12345-192.168.201.58@tcp:700:lfs.0 Request processed in 206us (772us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938335.305413:0:14297:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1784938335.310480:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.312472:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790528 00000100:00100000:0.0:1784938335.312489:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790528 00000100:00100000:0.0:1784938335.312707:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1784938335.312718:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+9:14387:x1871643048790528:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:0.0:1784938335.312774:0:14288:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938335.312800:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4ad3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897ca7 expref: 9 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.312822:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:0.0:1784938335.312827:0:14288:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938335.313134:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.313148:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 5 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.313158:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.313197:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 5 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.313210:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 5 pid: 14290 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938335.313256:0:14288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff883b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14288:1871643065561600:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938335.313869:0:14288:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a373c0 going to sleep for 11 seconds 00000100:00100000:3.0:1784938335.319344:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938335.319423:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790656 00000100:00100000:1.0:1784938335.319433:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790656 00010000:00010000:1.0:1784938335.319476:0:14274:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 6 pid: 14290 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938335.319531:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1784938335.319541:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:2355:x1871643048790656:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938335.319560:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938335.319567:0:14274:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 6 pid: 14290 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.319581:0:14274:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 6 pid: 14290 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.319605:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:1.0:1784938335.319612:0:14274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.319621:0:14274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.319639:0:14274:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.319658:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938335.319732:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8cedbaae-217c-4297-ba4f-37266cedd843+6:2355:x1871643048790656:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 192us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938335.319740:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00010000:00010000:0.0:1784938335.319950:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4b0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d09 expref: 5 pid: 14290 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938335.319974:0:14288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff883b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14288:1871643065561600:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938335.320006:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.320015:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.320023:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.320047:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.320057:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.320066:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938335.323846:0:14288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784938335.323868:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.323880:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.323887:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.323893:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938335.323907:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.323915:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.323931:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886be00) 00010000:00010000:0.0:1784938335.323934:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938335.323939:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.323945:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4ba5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938335.323969:0:14288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e5cc4f78 reply state 000000003383fa3a transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938335.323979:0:14288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938335.324882:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+10:14387:x1871643048790528:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 12160us (14406us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1784938335.324893:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00010000:00010000:0.0:1784938335.330594:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.330614:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.330624:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.330631:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938335.330636:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.330658:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.330674:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa05ad447eb00) 00010000:00010000:0.0:1784938335.330677:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938335.330683:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.330690:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4bac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.410299:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938335.410876:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.410954:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790784 00000100:00100000:2.0:1784938335.410967:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790784 00000100:00100000:2.0:1784938335.411198:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1784938335.411391:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+9:14395:x1871643048790784:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:2.0:1784938335.411440:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.411473:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bb3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d33 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.411566:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4bba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.411583:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.411598:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.411689:0:14289:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1784938335.411694:0:14289:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938335.411746:0:14289:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4bba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.411776:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bb3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d33 expref: 11 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.411803:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893000/0xea86628a8aec4bba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d33 expref: 10 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.411815:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938335.411817:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938335.411822:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893000, rc 0) 00000100:00100000:2.0:1784938335.411946:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+10:14395:x1871643048790784:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 736us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938335.411952:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784938335.440628:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938335.440736:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048790912 00000100:00100000:1.0:1784938335.440746:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048790912 00000100:00100000:1.0:1784938335.440814:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1784938335.440825:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+5:14396:x1871643048790912:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784938335.440848:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938335.440869:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4bc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d3a expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.440939:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4bc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.440954:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.440965:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938335.441036:0:14290:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1784938335.441039:0:14290:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1784938335.441072:0:14290:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4bc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.441102:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4bc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d3a expref: 7 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.441136:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991e00/0xea86628a8aec4bc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d3a expref: 6 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.441165:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938335.441169:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1784938335.441173:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991e00, rc 0) 00000100:00100000:1.0:1784938335.441309:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+6:14396:x1871643048790912:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 485us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938335.441317:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:0.0:1784938335.444189:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.449034:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048791040 00000100:00100000:2.0:1784938335.449052:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048791040 00000100:00100000:2.0:1784938335.449152:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1784938335.449164:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:14396:x1871643048791040:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938335.449190:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.449239:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4bcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d41 expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.449314:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.449329:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.449341:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.449356:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.449376:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.449384:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.450299:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4be4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.450312:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4be4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.450339:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4be4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.451159:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784938335.451167:0:15342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938335.451349:0:15342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4be4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.451950:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.451960:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.451968:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.451974:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.451979:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.451987:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452003:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938335.452006:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.452011:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452018:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4bd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452050:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452056:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452064:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452068:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.452071:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452076:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452084:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa05ad886b900) 00010000:00010000:2.0:1784938335.452087:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.452090:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452095:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bdd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452148:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4bcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d41 expref: 8 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452164:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4be4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d41 expref: 7 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.452181:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad886b600) 00010000:00010000:2.0:1784938335.452183:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1784938335.452186:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892e00, rc 0) 00000100:00100000:2.0:1784938335.452857:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+7:14396:x1871643048791040:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 3692us (8675us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938335.452867:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1784938335.462288:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938335.464813:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048791296 00000100:00100000:1.0:1784938335.464829:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048791296 00000100:00100000:1.0:1784938335.465037:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1784938335.465049:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+7:14396:x1871643048791296:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1784938335.465077:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938335.465101:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4beb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d48 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938335.465288:0:14290:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1784938335.465442:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4beb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d48 expref: 9 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.465458:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:1.0:1784938335.465461:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938335.465466:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4beb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d48 expref: 9 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.465480:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991600, rc 0) 00000100:00100000:1.0:1784938335.465556:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8cedbaae-217c-4297-ba4f-37266cedd843+8:14396:x1871643048791296:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 509us (3285us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1784938335.465578:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:3.0:1784938335.469181:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.469421:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048791552 00000100:00100000:2.0:1784938335.469439:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048791552 00000100:00100000:2.0:1784938335.469880:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:2.0:1784938335.469894:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cedbaae-217c-4297-ba4f-37266cedd843+8:14396:x1871643048791552:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:2.0:1784938335.469987:0:14289:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938335.470024:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4be4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d41 expref: 8 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.470052:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad886b600) 00010000:00010000:2.0:1784938335.470070:0:14289:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1784938335.470124:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.470145:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.470160:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938335.470977:0:14289:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000489e03e5 reply state 000000008ed5db24 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938335.471028:0:14289:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1784938335.471050:0:14289:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1784938335.471351:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8cedbaae-217c-4297-ba4f-37266cedd843+9:14396:x1871643048791552:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 1455us (2181us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1784938335.471362:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00010000:00010000:1.0:1784938335.474937:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.474962:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.474971:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.474978:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938335.474982:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.474990:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.475009:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad886b900) 00010000:00010000:1.0:1784938335.475012:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1784938335.475018:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938335.475025:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4bf9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938335.478986:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.485688:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048791808 00000100:00100000:2.0:1784938335.486666:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048791808 00000100:00100000:2.0:1784938335.486970:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784938335.486984:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cedbaae-217c-4297-ba4f-37266cedd843+8:14396:x1871643048791808:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938335.487424:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cedbaae-217c-4297-ba4f-37266cedd843+9:14396:x1871643048791808:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 441us (8454us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784938335.487433:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:1.0:1784938335.494869:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.495037:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048792064 00000100:00100000:0.0:1784938335.495055:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048792064 00000100:00100000:0.0:1784938335.495156:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1784938335.495169:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cedbaae-217c-4297-ba4f-37266cedd843+9:14396:x1871643048792064:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938335.495244:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938335.495282:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4c00 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d4f expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495407:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495426:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495440:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495480:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495487:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495492:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938335.495683:0:14288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1784938335.495822:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495833:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495841:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495847:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938335.495853:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495861:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495876:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938335.495879:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938335.495884:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495900:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c07 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495919:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495939:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495945:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495950:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938335.495953:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495958:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495966:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa05ad447eb00) 00010000:00010000:0.0:1784938335.495968:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938335.495971:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.495976:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c0e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.496022:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4c00 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d4f expref: 11 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.496043:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:0.0:1784938335.496045:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938335.496049:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4c00 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d4f expref: 11 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.496058:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6836400, rc 0) 00000100:00100000:0.0:1784938335.496162:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8cedbaae-217c-4297-ba4f-37266cedd843+10:14396:x1871643048792064:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 995us (1307us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1784938335.496171:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1784938335.506878:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.506983:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048792192 00000100:00100000:0.0:1784938335.506999:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048792192 00000100:00100000:0.0:1784938335.507083:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:0.0:1784938335.507095:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+10:14396:x1871643048792192:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1784938335.507138:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938335.507175:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4c1c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d56 expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.507355:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.507376:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.507391:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938335.507469:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1784938335.507492:0:15342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938335.507524:0:15342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.507556:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837e00/0xea86628a8aec4c1c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 12 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.507581:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 11 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.507592:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad447e600) 00010000:00010000:0.0:1784938335.507595:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1784938335.507599:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6836600, rc 0) 00000100:00100000:0.0:1784938335.507683:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+11:14396:x1871643048792192:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 590us (821us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938335.507690:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:0.0:1784938335.517517:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.517638:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048792320 00000100:00100000:2.0:1784938335.517664:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048792320 00000100:00100000:2.0:1784938335.517745:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1784938335.517756:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cedbaae-217c-4297-ba4f-37266cedd843+11:14396:x1871643048792320:12345-192.168.201.58@tcp:37:lfs.0 00000100:00100000:3.0:1784938335.524888:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8cedbaae-217c-4297-ba4f-37266cedd843+11:14396:x1871643048792320:12345-192.168.201.58@tcp:37:lfs.0 Request processed in 7115us (7368us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938335.524913:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1784938335.532425:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938335.532608:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048792576 00000100:00100000:3.0:1784938335.532621:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048792576 00000100:00100000:3.0:1784938335.532750:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1784938335.532762:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afc8ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cedbaae-217c-4297-ba4f-37266cedd843+11:14396:x1871643048792576:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1784938335.533162:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afc8ae450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8cedbaae-217c-4297-ba4f-37266cedd843+12:14396:x1871643048792576:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 401us (751us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1784938335.533172:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1784938335.624380:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.624563:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048792704 00000100:00100000:2.0:1784938335.624577:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048792704 00000100:00100000:2.0:1784938335.624670:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:2.0:1784938335.624682:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+10:14402:x1871643048792704:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938335.624713:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.624743:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d5d expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.624867:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.624885:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.624900:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.624916:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.624924:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.624931:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625079:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec4c3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625090:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec4c3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625097:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec4c3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.625147:0:14288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1784938335.625152:0:14288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938335.625247:0:14288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec4c3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625274:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625282:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625288:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625295:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893600 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.625300:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625309:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625324:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938335.625327:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.625338:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625346:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625361:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625368:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625373:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625385:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.625389:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625395:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625404:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffffa05ad886b600) 00010000:00010000:2.0:1784938335.625406:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.625409:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625415:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c38 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625454:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d5d expref: 12 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625469:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892000/0xea86628a8aec4c3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d5d expref: 11 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.625476:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad447e600) 00010000:00010000:2.0:1784938335.625478:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1784938335.625480:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892000, rc 0) 00000100:00100000:2.0:1784938335.625564:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+11:14402:x1871643048792704:12345-192.168.201.58@tcp:101:bash.0 Request processed in 884us (1198us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938335.625572:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1784938335.630349:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.630600:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048792960 00000100:00100000:0.0:1784938335.630626:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048792960 00000100:00100000:0.0:1784938335.630715:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1784938335.630728:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+11:14402:x1871643048792960:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1784938335.630761:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938335.630802:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4c46 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d64 expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.630983:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.631024:0:15342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 11 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.631034:0:15342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.631092:0:15342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 11 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.631116:0:15342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 11 pid: 15342 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938335.631133:0:15342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff880000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15342:1871643065561728:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938335.631615:0:15342:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a373c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938335.637773:0:15342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff880000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15342:1871643065561728:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938335.637819:0:15342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938335.640430:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.640720:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048793088 00000100:00100000:0.0:1784938335.640732:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048793088 00010000:00010000:0.0:1784938335.640801:0:16301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 12 pid: 15342 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938335.640856:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784938335.640868:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cedbaae-217c-4297-ba4f-37266cedd843+12:2357:x1871643048793088:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938335.640889:0:16301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938335.640917:0:16301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 12 pid: 15342 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.640932:0:16301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 12 pid: 15342 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.640963:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836600/0xea86628a8aec4c23 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d56 expref: 12 pid: 15342 timeout: 644 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.640987:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad447e600) 00010000:00010000:0.0:1784938335.640993:0:16301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.641005:0:16301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.641014:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.641051:0:16301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938335.641138:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8cedbaae-217c-4297-ba4f-37266cedd843+11:2357:x1871643048793088:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 271us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938335.641146:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00010000:00010000:2.0:1784938335.641376:0:15342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.641392:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.641422:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.641433:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.641442:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642430:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642448:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642458:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.642473:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784938335.642511:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642521:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642528:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642535:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836a00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938335.642550:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642559:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642573:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad447e600) 00010000:00010000:2.0:1784938335.642577:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938335.642583:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642590:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836a00/0xea86628a8aec4c4d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1784938335.642607:0:15342:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad04cffe reply state 00000000c50b611e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938335.642617:0:15342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1784938335.642661:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836400/0xea86628a8aec4c46 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 14 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642678:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 13 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.642685:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938335.642687:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1784938335.642689:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893e00, rc 0) 00000100:00100000:2.0:1784938335.642777:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+14:14402:x1871643048792960:12345-192.168.201.58@tcp:101:bash.0 Request processed in 12050us (12445us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1784938335.642787:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00010000:00010000:3.0:1784938335.645760:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.645786:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.645795:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.645802:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc892e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:3.0:1784938335.645828:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.645839:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.645864:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffffa05ad886b500) 00010000:00010000:3.0:1784938335.645868:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1784938335.645874:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938335.645881:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892e00/0xea86628a8aec4c54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938335.657058:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.657198:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048793216 00000100:00100000:2.0:1784938335.657352:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048793216 00000100:00100000:2.0:1784938335.657442:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1784938335.657455:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+13:14402:x1871643048793216:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1784938335.657488:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.657517:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c69 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d6b expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657639:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657658:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657673:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.657737:0:14288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1784938335.657742:0:14288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1784938335.657766:0:14288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657779:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657809:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c69 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 15 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657830:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 14 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.657853:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938335.657856:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938335.657861:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892800, rc 0) 00000100:00100000:2.0:1784938335.657942:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+14:14402:x1871643048793216:12345-192.168.201.58@tcp:101:bash.0 Request processed in 489us (895us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938335.657950:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784938335.660759:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938335.661319:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048793472 00000100:00100000:3.0:1784938335.661333:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048793472 00000100:00100000:3.0:1784938335.661443:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1784938335.661456:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+14:14402:x1871643048793472:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1784938335.661918:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+15:14402:x1871643048793472:12345-192.168.201.58@tcp:35:bash.0 Request processed in 463us (1169us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1784938335.661926:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1784938335.733286:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.735534:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048793728 00000100:00100000:2.0:1784938335.735558:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048793728 00000100:00100000:2.0:1784938335.735770:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:2.0:1784938335.735784:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+15:14412:x1871643048793728:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938335.735822:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.735851:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d72 expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.736023:0:14289:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1784938335.736191:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d72 expref: 17 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.736210:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffffa05ad886ba00) 00010000:00010000:2.0:1784938335.736247:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1784938335.736256:0:14289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d72 expref: 17 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.736277:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893200, rc 0) 00000100:00100000:2.0:1784938335.736363:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac822c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+16:14412:x1871643048793728:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 582us (3091us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1784938335.736390:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:1.0:1784938335.741114:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.748038:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048793984 00000100:00100000:2.0:1784938335.748070:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048793984 00000100:00100000:2.0:1784938335.748171:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1784938335.753595:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+16:14412:x1871643048793984:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1784938335.754063:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+17:14412:x1871643048793984:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 5874us (12962us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1784938335.754077:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1784938335.814258:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938335.814426:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048794240 00000100:00100000:2.0:1784938335.814441:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048794240 00000100:00100000:2.0:1784938335.814530:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1784938335.814543:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+17:14415:x1871643048794240:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1784938335.814579:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938335.814608:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c85 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d79 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.814744:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c8c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.814761:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.814777:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c8c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938335.814791:0:14288:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784938335.815298:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4c85 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d79 expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.815341:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c8c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d79 expref: 19 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938335.815354:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938335.815357:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1784938335.815362:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893600, rc 0) 00000100:00100000:2.0:1784938335.815514:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+19:14415:x1871643048794240:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 974us (1305us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784938335.815523:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1784938335.829410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938335.829462:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.829687:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048794368 00000100:00100000:0.0:1784938335.829699:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048794368 00000100:00100000:0.0:1784938335.829779:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:0.0:1784938335.829790:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+19:14415:x1871643048794368:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1784938335.829899:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829918:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829931:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829963:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829969:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829976:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829983:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938335.829987:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.829995:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.830017:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938335.830021:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1784938335.830026:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.830032:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4c9a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938335.830145:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+19:14415:x1871643048794368:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 357us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938335.830153:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1784938335.834300:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938335.834544:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048794752 00000100:00100000:0.0:1784938335.834557:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048794752 00000100:00100000:0.0:1784938335.834643:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1784938335.834654:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+19:14415:x1871643048794752:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1784938335.834975:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+20:14415:x1871643048794752:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 322us (689us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1784938335.834984:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784938335.839385:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048794496 00000100:00100000:1.0:1784938335.839434:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048794496 00000100:00100000:0.0:1784938335.839738:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784938335.839750:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+20:2356:x1871643048794496:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938335.839777:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938335.839818:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893600/0xea86628a8aec4c8c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d79 expref: 20 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938335.839842:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938335.839848:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938335.839959:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+19:2356:x1871643048794496:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 210us (10495us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938335.839968:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1784938336.051204:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.051509:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048795008 00000100:00100000:1.0:1784938336.051524:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048795008 00000100:00100000:1.0:1784938336.051630:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1784938336.051643:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+19:14446:x1871643048795008:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:1.0:1784938336.051680:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938336.051710:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4ca1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d80 expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.051856:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4ca8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.051888:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.051905:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4ca8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938336.051920:0:14290:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784938336.052137:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4ca1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d80 expref: 22 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.052162:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4ca8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d80 expref: 21 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.052174:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938336.052177:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00000100:00080000:2.0:1784938336.052180:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1784938336.052182:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990200, rc 0) 00000100:00100000:1.0:1784938336.052333:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+21:14446:x1871643048795008:12345-192.168.201.58@tcp:101:cat.0 Request processed in 692us (1146us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1784938336.052365:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:3.0:1784938336.056176:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.056529:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.056625:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048795392 00000100:00100000:0.0:1784938336.056639:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048795392 00000100:00100000:0.0:1784938336.056709:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1784938336.056719:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+21:14446:x1871643048795392:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1784938336.057476:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+22:14446:x1871643048795392:12345-192.168.201.58@tcp:35:cat.0 Request processed in 755us (944us total) trans 8589934607 rc 0/0 00000100:00100000:0.0:1784938336.057486:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1784938336.057544:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048795136 00000100:00100000:1.0:1784938336.057552:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048795136 00000100:00100000:1.0:1784938336.057608:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:1.0:1784938336.057616:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+22:2358:x1871643048795136:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938336.057630:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938336.057665:0:14273:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4ca8 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d80 expref: 22 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.057684:0:14273:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938336.057690:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938336.057715:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+21:2358:x1871643048795136:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 101us (1557us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.057722:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1784938336.105860:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.105994:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048795648 00000100:00100000:2.0:1784938336.106009:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048795648 00000100:00100000:2.0:1784938336.106090:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:2.0:1784938336.106113:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+21:14452:x1871643048795648:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:2.0:1784938336.106146:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938336.106175:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4cb6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d87 expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.106349:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.106367:0:15342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.106374:0:15342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 22 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.106404:0:15342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.106444:0:15342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 22 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.106459:0:15342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 22 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.106476:0:15342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbeadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15342:1871643065561856:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938336.107001:0:15342:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.107014:0:15342:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.107025:0:15342:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05afbead880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15342:1871643065561984:192.168.201.58@tcp:104: 00000100:00100000:2.0:1784938336.107069:0:15342:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac68de6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1784938336.113708:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.113931:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048795776 00000100:00100000:1.0:1784938336.113943:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048795776 00000100:00100000:2.0:1784938336.113948:0:15342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbeadf80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15342:1871643065561856:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938336.114000:0:14274:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 23 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.114053:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:1.0:1784938336.114064:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afff20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+23:2355:x1871643048795776:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938336.114088:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938336.114109:0:14274:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 23 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.114123:0:14274:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 23 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.114165:0:14274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892800/0xea86628a8aec4c70 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d6b expref: 23 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.114187:0:14274:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938336.114193:0:14274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.114202:0:14274:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.114209:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938336.114331:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afff20050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+22:2355:x1871643048795776:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 268us (640us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.114340:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1784938336.116696:0:15342:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05afbead880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15342:1871643065561984:192.168.201.58@tcp:104: 00010000:00010000:2.0:1784938336.116739:0:15342:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.120402:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.121195:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048795904 00000100:00100000:3.0:1784938336.121260:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048795904 00010000:00010000:3.0:1784938336.121321:0:16301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938336.121655:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1784938336.121671:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+22:2356:x1871643048795904:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1784938336.121692:0:16301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1784938336.121702:0:16301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.121719:0:16301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.121747:0:16301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4c5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d64 expref: 22 pid: 15342 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.121765:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:3.0:1784938336.121771:0:16301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.121783:0:16301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.121792:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.121830:0:16301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1784938336.121912:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+21:2356:x1871643048795904:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 245us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938336.121933:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00010000:00010000:2.0:1784938336.122290:0:15342:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.122311:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1784938336.122338:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1784938336.122598:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4cb6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d87 expref: 22 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.122620:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc892200/0xea86628a8aec4cbd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d87 expref: 21 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.122629:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938336.122631:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1784938336.122635:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc892200, rc 0) 00000100:00100000:2.0:1784938336.122676:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+21:14452:x1871643048795648:12345-192.168.201.58@tcp:101:dd.0 Request processed in 16576us (16833us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1784938336.122686:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:1.0:1784938336.132734:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.132989:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048796160 00000100:00100000:0.0:1784938336.133005:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048796160 00000100:00100000:0.0:1784938336.133092:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1784938336.133115:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+21:14452:x1871643048796160:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1784938336.137283:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.137317:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.137331:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938336.137405:0:14288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1784938336.137456:0:14288:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005a57d5b2 reply state 00000000edd9ba0a transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.137468:0:14288:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938336.137700:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14452:x1871643048796160:12345-192.168.201.58@tcp:36:dd.0 Request processed in 4581us (4975us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1784938336.137711:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000020:00080000:0.0:1784938336.137719:0:14288:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1784938336.143163:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.143307:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048796288 00000100:00100000:2.0:1784938336.143322:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048796288 00000100:00100000:2.0:1784938336.143418:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:2.0:1784938336.143432:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14452:x1871643048796288:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:2.0:1784938336.143467:0:14289:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1784938336.143673:0:14289:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4cd2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d8e expref: -99 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.143759:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d8e expref: 25 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.143800:0:14289:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4cd2 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d8e expref: 25 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.143827:0:14289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938336.143830:0:14289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938336.143834:0:14289:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05afc893200, rc 0) 00000100:00100000:2.0:1784938336.143921:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14452:x1871643048796288:12345-192.168.201.58@tcp:101:dd.0 Request processed in 493us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938336.143930:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00010000:00010000:1.0:1784938336.145905:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.145927:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.145936:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.145942:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938336.145949:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.145958:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.146007:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938336.146010:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938336.146016:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.146023:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837200/0xea86628a8aec4ccb lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.164441:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.164580:0:14275:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048796544 00000100:00100000:2.0:1784938336.164595:0:14275:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048796544 00000100:00100000:2.0:1784938336.164685:0:14275:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784938336.164698:0:14275:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14452:x1871643048796544:12345-192.168.201.58@tcp:103:dd.0 00010000:00010000:2.0:1784938336.164721:0:14275:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1784938336.164758:0:14275:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893200/0xea86628a8aec4cd2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d8e expref: 24 pid: 14289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.164843:0:14275:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938336.164850:0:14275:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1784938336.164925:0:14275:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+23:14452:x1871643048796544:12345-192.168.201.58@tcp:103:dd.0 Request processed in 230us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938336.164934:0:14275:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1784938336.166826:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.166945:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048796672 00000100:00100000:1.0:1784938336.166959:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048796672 00000100:00100000:1.0:1784938336.167030:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1784938336.167041:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+23:14452:x1871643048796672:12345-192.168.201.58@tcp:58:dd.0 00010000:00010000:1.0:1784938336.167246:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.167266:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.167280:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1784938336.168248:0:14290:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1784938336.168443:0:14290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1784938336.168536:0:14290:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1784938336.168704:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+23:14452:x1871643048796672:12345-192.168.201.58@tcp:58:dd.0 Request processed in 1657us (1882us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.168717:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:3.0:1784938336.172334:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.172432:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048796800 00000100:00100000:0.0:1784938336.172446:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048796800 00000100:00100000:0.0:1784938336.172526:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1784938336.172538:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+23:14452:x1871643048796800:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1784938336.172567:0:15342:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938336.172598:0:15342:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d95 expref: -99 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.172690:0:15342:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.172703:0:15342:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 24 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.172727:0:15342:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.172743:0:15342:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 24 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.172761:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938336.172766:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1784938336.172771:0:15342:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 24 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.172780:0:15342:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6837400, rc 0) 00000100:00100000:0.0:1784938336.172873:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14452:x1871643048796800:12345-192.168.201.58@tcp:101:dd.0 Request processed in 337us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.172881:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000040:00080000:1.0:1784938336.177666:0:14322:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784938336.177681:0:14322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938336.177748:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784938336.177755:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:1.0:1784938336.177934:0:14322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14322:1871643065562112:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1784938336.178159:0:14322:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6900 going to sleep for 11 seconds 00000100:00100000:3.0:1784938336.184629:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.187426:0:14299:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048796928 00000100:00100000:0.0:1784938336.187450:0:14299:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048796928 00000100:00100000:0.0:1784938336.187543:0:14299:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1784938336.187557:0:14299:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14453:x1871643048796928:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1784938336.187687:0:14299:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14453:x1871643048796928:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 Request processed in 133us (3074us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.187697:0:14299:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784938336.188457:0:14322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01fd2d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14322:1871643065562112:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1784938336.190479:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.190686:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048797056 00000100:00100000:1.0:1784938336.190698:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048797056 00000100:00100000:1.0:1784938336.190773:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1784938336.190785:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14453:x1871643048797056:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1784938336.190830:0:14290:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1784938336.190972:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14453:x1871643048797056:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 188us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.190981:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1784938336.195533:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.198372:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048797184 00000100:00100000:0.0:1784938336.198394:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048797184 00000100:00100000:0.0:1784938336.198502:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:0.0:1784938336.198515:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14453:x1871643048797184:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1784938336.198621:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198643:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198657:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198713:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198722:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198730:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198762:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198802:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198809:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1784938336.198866:0:15342:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1784938336.198871:0:15342:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1784938336.198893:0:15342:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198907:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198914:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198921:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198927:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938336.198932:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198940:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198956:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac7d19500) 00010000:00010000:0.0:1784938336.198959:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938336.198965:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.198983:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4ce7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199006:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199012:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199018:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199023:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938336.199026:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199033:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199040:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffffa05ad447eb00) 00010000:00010000:0.0:1784938336.199043:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938336.199046:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199051:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4cee lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199070:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199076:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199090:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199104:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938336.199108:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199115:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199124:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:0.0:1784938336.199127:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938336.199130:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.199137:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4cf5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.199307:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14453:x1871643048797184:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 793us (3787us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.199317:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1784938336.205356:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.205566:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048797440 00000100:00100000:1.0:1784938336.205579:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048797440 00000100:00100000:1.0:1784938336.205683:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784938336.205695:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+24:14453:x1871643048797440:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938336.205726:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938336.205758:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4cfc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897d9c expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.205899:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.205916:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.205953:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1784938336.205967:0:14290:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1784938336.206118:0:14290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206127:0:14290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206134:0:14290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206141:0:14290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8991200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938336.206146:0:14290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206155:0:14290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206171:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:1.0:1784938336.206174:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1784938336.206190:0:14290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206197:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d03 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206278:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4cfc lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d9c expref: 26 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206301:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffffa05ac7d19500) 00010000:00010000:1.0:1784938336.206303:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1784938336.206308:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4cfc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d9c expref: 26 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.206318:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991600, rc 0) 00000100:00100000:1.0:1784938336.206396:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14453:x1871643048797440:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 704us (1056us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1784938336.206404:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1784938336.209843:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.209942:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048797568 00000100:00100000:0.0:1784938336.209956:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048797568 00000100:00100000:0.0:1784938336.210027:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1784938336.210038:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14453:x1871643048797568:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1784938336.210103:0:15342:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1784938336.210333:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14453:x1871643048797568:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 295us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.210352:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1784938336.212849:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.217962:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048797824 00000100:00100000:0.0:1784938336.217989:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048797824 00000100:00100000:0.0:1784938336.221435:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:0.0:1784938336.221474:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+25:14453:x1871643048797824:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1784938336.221508:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1784938336.221543:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d11 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897da3 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1784938336.223015:0:14288:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:0.0:1784938336.223029:0:14288:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:0.0:1784938336.223104:0:14288:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1784938336.223653:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4d18 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.223676:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4d18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.223693:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4d18 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.225372:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d11 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897da3 expref: 28 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.225416:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4d18 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897da3 expref: 27 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.225428:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ad447eb00) 00010000:00010000:0.0:1784938336.225452:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1784938336.225457:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac6836200, rc 0) 00000100:00100000:0.0:1784938336.225632:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+27:14453:x1871643048797824:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 4175us (12796us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1784938336.225644:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1784938336.239571:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.241144:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048798080 00000100:00100000:0.0:1784938336.241162:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048798080 00000100:00100000:0.0:1784938336.241278:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1784938336.241291:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+27:14453:x1871643048798080:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938336.241380:0:15342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938336.241419:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836200/0xea86628a8aec4d18 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897da3 expref: 27 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241449:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ad447eb00) 00010000:00010000:0.0:1784938336.241464:0:15342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938336.241497:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241515:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241527:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241605:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241614:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241647:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241756:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241833:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241842:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241849:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938336.241854:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241863:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241872:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffffa05ad447e600) 00010000:00010000:0.0:1784938336.241875:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938336.241879:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241886:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6836e00/0xea86628a8aec4d26 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241897:0:15342:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241903:0:15342:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241916:0:15342:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241922:0:15342:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938336.241925:0:15342:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241931:0:15342:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241939:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xef48b2dc (ffffa05ad447e900) 00010000:00010000:0.0:1784938336.241942:0:15342:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1784938336.241945:0:15342:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.241951:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d2d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xef48b2dc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.242290:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+26:14453:x1871643048798080:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 999us (2731us total) trans 0 rc -2/-2 00000100:00100000:0.0:1784938336.242300:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:2.0:1784938336.257640:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.264593:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048798208 00000100:00100000:1.0:1784938336.264617:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048798208 00000100:00100000:1.0:1784938336.264712:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1784938336.264725:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+26:14453:x1871643048798208:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938336.264755:0:14290:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938336.264796:0:14290:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d34 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897daa expref: -99 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.264848:0:14290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4d3b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.264865:0:14290:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.264893:0:14290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4d3b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.265044:0:14290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991200/0xea86628a8aec4d34 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897daa expref: 28 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.265070:0:14290:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8991600/0xea86628a8aec4d3b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897daa expref: 27 pid: 14290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.265081:0:14290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:1.0:1784938336.265084:0:14290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1784938336.265088:0:14290:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991600, rc 0) 00000100:00100000:1.0:1784938336.265710:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbead880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+27:14453:x1871643048798208:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 984us (8084us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.265719:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1784938336.276954:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.277066:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048798464 00000100:00100000:3.0:1784938336.277079:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048798464 00000100:00100000:3.0:1784938336.277171:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:3.0:1784938336.277188:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+27:14453:x1871643048798464:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1784938336.277354:0:14289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.277376:0:14289:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.277390:0:14289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1784938336.277957:0:14289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1784938336.277972:0:14289:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 545220755868ns, next at 546220752740ns, rc = 0 00000004:00010000:3.0:1784938336.278088:0:14289:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e78c3b2d reply state 0000000081a6c718 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938336.278116:0:14289:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1784938336.278313:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+29:14453:x1871643048798464:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1130us (1372us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1784938336.278323:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00010000:00010000:0.0:1784938336.281440:0:3307:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.281466:0:3307:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.281475:0:3307:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.281569:0:3307:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:0.0:1784938336.281576:0:3307:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.281586:0:3307:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.281608:0:3307:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:0.0:1784938336.281611:0:3307:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1784938336.281617:0:3307:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.281624:0:3307:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87d200/0xea86628a8aec4d42 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14289 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.288197:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.289002:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048798592 00000100:00100000:3.0:1784938336.289018:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048798592 00000100:00100000:3.0:1784938336.289127:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1784938336.289140:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+28:14453:x1871643048798592:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938336.289175:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938336.289209:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897db1 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.289321:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 29 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.289339:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 29 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.289364:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:3.0:1784938336.289367:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1784938336.289372:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87c600, rc 0) 00000100:00100000:3.0:1784938336.289446:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+29:14453:x1871643048798592:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 309us (1270us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938336.289453:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1784938336.292374:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.292481:0:14925:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048798720 00000100:00100000:3.0:1784938336.292495:0:14925:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048798720 00000100:00100000:3.0:1784938336.292594:0:14925:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1784938336.292608:0:14925:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2356:x1871643048798720:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1784938336.292816:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1784938336.293126:0:14925:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01fd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2356:x1871643048798720:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 520us (769us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1784938336.293135:0:14925:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1784938336.295385:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.295490:0:14291:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048798976 00000100:00100000:3.0:1784938336.295504:0:14291:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048798976 00000100:00100000:3.0:1784938336.295579:0:14291:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1784938336.295591:0:14291:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+29:14453:x1871643048798976:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1784938336.295942:0:14291:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+30:14453:x1871643048798976:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 353us (571us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1784938336.295951:0:14291:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1784938336.299033:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.299132:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048799232 00000100:00100000:0.0:1784938336.299146:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048799232 00000100:00100000:0.0:1784938336.299261:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1784938336.299274:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+30:14453:x1871643048799232:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1784938336.299421:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+30:14453:x1871643048799232:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 151us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.299428:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:1.0:1784938336.301369:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.301651:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048799360 00000100:00100000:3.0:1784938336.301660:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048799360 00000100:00100000:3.0:1784938336.301723:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:3.0:1784938336.301734:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa059c1086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+30:14453:x1871643048799360:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1784938336.301763:0:14288:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1784938336.301796:0:14288:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d50 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897db8 expref: -99 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.301892:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d57 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.301909:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.301922:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1784938336.301991:0:14288:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1784938336.302013:0:14288:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d57 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.302043:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d50 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db8 expref: 32 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.302066:0:14288:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d57 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db8 expref: 31 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.302074:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:3.0:1784938336.302078:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1784938336.302082:0:14288:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05aff87ce00, rc 0) 00000100:00100000:3.0:1784938336.302290:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa059c1086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048799360:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 556us (930us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938336.302298:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1784938336.328667:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.330158:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048799488 00000100:00100000:1.0:1784938336.330176:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048799488 00000100:00100000:1.0:1784938336.330274:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1784938336.330286:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+6:2355:x1871643048799488:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938336.330311:0:14926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938336.330342:0:14926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897dbf expref: -99 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1784938336.330388:0:14926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a63ff61, blocks: 0x1 00010000:00010000:1.0:1784938336.330418:0:14926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=545s v=(0 0) 00010000:00010000:1.0:1784938336.330424:0:14926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.330455:0:14926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 7 pid: 14926 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.330481:0:14926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 7 pid: 14926 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.330499:0:14926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8991200, rc 0) 00000100:00100000:1.0:1784938336.330586:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeaf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2355:x1871643048799488:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 301us (1935us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.330594:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1784938336.345330:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.345406:0:14289:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048799744 00000100:00100000:3.0:1784938336.345421:0:14289:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048799744 00000100:00100000:3.0:1784938336.345503:0:14289:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1784938336.345515:0:14289:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048799744:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1784938336.345661:0:14289:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afbeae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048799744:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 149us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938336.345672:0:14289:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:1.0:1784938336.350004:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.350123:0:14290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048799872 00000100:00100000:2.0:1784938336.350137:0:14290:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048799872 00000100:00100000:2.0:1784938336.350232:0:14290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:2.0:1784938336.350244:0:14290:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048799872:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1784938336.350432:0:14290:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048799872:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 190us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938336.350440:0:14290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1784938336.357942:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.361497:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800000 00000100:00100000:2.0:1784938336.361531:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800000 00000100:00100000:2.0:1784938336.361631:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1784938336.361645:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2356:x1871643048800000:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1784938336.361887:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2356:x1871643048800000:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 245us (3960us total) trans 0 rc 0/0 00000100:00100000:2.0:1784938336.361896:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784938336.369030:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.369118:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800256 00000100:00100000:0.0:1784938336.369132:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800256 00000100:00100000:0.0:1784938336.369202:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1784938336.369234:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048800256:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1784938336.369332:0:15342:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938336.369378:0:15342:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d57 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db8 expref: 31 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.369405:0:15342:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:0.0:1784938336.369412:0:15342:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1784938336.369460:0:15342:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.369477:0:15342:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.369487:0:15342:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1784938336.370003:0:15342:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b810e3ff reply state 00000000d6b69146 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.370017:0:15342:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1784938336.370274:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+32:14453:x1871643048800256:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1258us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1784938336.370285:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00010000:00010000:1.0:1784938336.377503:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.377523:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.377532:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.377538:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6837000 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:1.0:1784938336.377544:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.377554:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.377579:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:1.0:1784938336.377582:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1784938336.377617:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.377631:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837000/0xea86628a8aec4d65 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15342 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.385535:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.388268:0:14926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800384 00000100:00100000:1.0:1784938336.388290:0:14926:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800384 00000100:00100000:1.0:1784938336.388402:0:14926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784938336.388416:0:14926:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+7:14453:x1871643048800384:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1784938336.388441:0:14926:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1784938336.388470:0:14926:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xcbec0c397a897dc6 expref: -99 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.388511:0:14926:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 8 pid: 14926 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.388522:0:14926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.388527:0:14926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.388533:0:14926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 8 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.388579:0:14926:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 8 pid: 14926 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.388596:0:14926:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 8 pid: 14926 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.388642:0:14926:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14926:1871643065562240:192.168.201.58@tcp:104: 00000100:00100000:1.0:1784938336.388767:0:14926:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6480 going to sleep for 11 seconds 00000100:00100000:1.0:1784938336.395866:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.395910:0:14273:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800512 00000100:00100000:1.0:1784938336.395922:0:14273:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800512 00010000:00010000:1.0:1784938336.395973:0:14273:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 9 pid: 14926 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.396019:0:14273:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938336.396044:0:14273:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+9:2355:x1871643048800512:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1784938336.396063:0:14273:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1784938336.396105:0:14273:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 9 pid: 14926 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.396121:0:14273:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 9 pid: 14926 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.396156:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.396161:0:14273:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.396169:0:14273:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 9 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.396185:0:14273:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 9 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.396275:0:14273:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 9 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.396293:0:14273:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14273:1871643065562368:192.168.201.58@tcp:105: 00000100:00100000:1.0:1784938336.396385:0:14273:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6900 going to sleep for 11 seconds 00010000:00010000:3.0:1784938336.398901:0:14926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d368150/0xea86628a8aec4d5e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dbf expref: 9 pid: 14926 timeout: 645 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938336.398970:0:14926:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05b01ddc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:14926:1871643065562240:192.168.201.58@tcp:104: 00010000:00010000:3.0:1784938336.399011:0:14926:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 8 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.399030:0:14926:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffffa05ac8990e00, rc 0) 00000100:00100000:3.0:1784938336.399118:0:14926:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:fab6306c-39cb-46f6-95e0-7a5423945d94+8:14453:x1871643048800384:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 10705us (13601us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938336.399130:0:14926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1784938336.407260:0:14273:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee074e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:14273:1871643065562368:192.168.201.58@tcp:105: 00010000:00010000:1.0:1784938336.407300:0:14273:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1784938336.407382:0:14273:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2355:x1871643048800512:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 11352us (11530us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.407397:0:14273:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1784938336.407479:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.407572:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800640 00000100:00100000:2.0:1784938336.407584:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800640 00000100:00100000:2.0:1784938336.407645:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1784938336.407655:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2355:x1871643048800640:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1784938336.407866:0:14924:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1784938336.407870:0:14924:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1784938337 00002000:00010000:2.0:1784938336.407872:0:14924:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1784938336 00002000:00010000:2.0:1784938336.407894:0:14924:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1784938337 -> 1784938337 00002000:00010000:2.0:1784938336.407896:0:14924:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1784938336.407931:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+8:2355:x1871643048800640:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 278us (453us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1784938336.407939:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1784938336.410881:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.410929:0:16021:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800768 00000100:00100000:0.0:1784938336.410943:0:16021:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800768 00000100:00100000:0.0:1784938336.411008:0:16021:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784938336.411020:0:16021:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+8:2355:x1871643048800768:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1784938336.411081:0:16021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.411129:0:16021:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 8 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.411140:0:16021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938336.411145:0:16021:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938336.411150:0:16021:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.411200:0:16021:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 8 pid: 14926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.411242:0:16021:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 8 pid: 14926 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.411265:0:16021:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aff882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16021:1871643065562496:192.168.201.58@tcp:104: 00000100:00100000:0.0:1784938336.411445:0:16021:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac4a37c00 going to sleep for 11 seconds 00000100:00100000:0.0:1784938336.414287:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.414336:0:14274:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048800896 00000100:00100000:0.0:1784938336.414348:0:14274:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048800896 00010000:00010000:0.0:1784938336.414414:0:14274:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 9 pid: 14926 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.414458:0:14274:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1784938336.414469:0:14274:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+9:2356:x1871643048800896:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938336.414499:0:14274:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938336.414528:0:14274:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 9 pid: 14926 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.414543:0:14274:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 9 pid: 14926 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.414574:0:14274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938336.414579:0:14274:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1784938336.414586:0:14274:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.414598:0:14274:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.414633:0:14274:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938336.415004:0:14274:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff883100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+9:2356:x1871643048800896:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 535us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.415014:0:14274:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:0.0:1784938336.415080:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec646e4f/0xea86628a8aec4d6c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897dc6 expref: 8 pid: 14926 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.415108:0:16021:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aff882680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:16021:1871643065562496:192.168.201.58@tcp:104: 00010000:00010000:0.0:1784938336.415134:0:16021:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415159:0:16021:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415167:0:16021:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415198:0:16021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415208:0:16021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415241:0:16021:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415249:0:16021:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938336.415253:0:16021:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415263:0:16021:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415277:0:16021:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.415296:0:16021:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000060aa245f/0xea86628a8aec4d73 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16021 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.417000:0:16021:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2355:x1871643048800768:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 5970us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.417018:0:16021:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1784938336.420026:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.420551:0:14288:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048801152 00000100:00100000:3.0:1784938336.420568:0:14288:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048801152 00000100:00100000:3.0:1784938336.420646:0:14288:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:3.0:1784938336.420658:0:14288:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+31:14453:x1871643048801152:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1784938336.420935:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.420960:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.420976:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.421629:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.421647:0:14288:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 32 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.421669:0:14288:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.421902:0:14288:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 32 pid: 14288 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.421924:0:14288:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 32 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1784938336.421944:0:14288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aedc97480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14288:1871643065562624:192.168.201.58@tcp:104: 00000100:00100000:3.0:1784938336.422330:0:14288:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ae17119c0 going to sleep for 11 seconds 00000001:00080000:1.0:1784938336.426888:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934612 is committed 00000001:00080000:1.0:1784938336.426927:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1784938336.426980:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1784938336.426988:0:5828:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:1.0:1784938336.427013:0:5828:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1784938336.427347:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1784938336.427390:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae1689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065562752:192.168.201.158@tcp:2:osp-syn-0-0.0 00000100:00100000:0.0:1784938336.427927:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938336.427992:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065562752 00000100:00100000:2.0:1784938336.428003:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065562752 00000100:00100000:2.0:1784938336.428076:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 19 00000100:00100000:2.0:1784938336.428088:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065562752:12345-192.168.201.158@tcp:2:osp-syn-0-0.0 00000100:00100000:3.0:1784938336.428637:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3322:x1871643065562752:12345-192.168.201.158@tcp:2:osp-syn-0-0.0 Request processed in 547us (708us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1784938336.428648:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 19 00000004:00080000:0.0:1784938336.429436:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffffa05ae1689c00/2, rc 0, transno 8589934596 00000100:00100000:0.0:1784938336.429451:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae1689c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065562752:192.168.201.158@tcp:2:osp-syn-0-0.0 00000100:00100000:3.0:1784938336.429629:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1784938336.429717:0:16301:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048801280 00000100:00100000:0.0:1784938336.429797:0:16301:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048801280 00010000:00010000:0.0:1784938336.429850:0:16301:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 16 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.429899:0:16301:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1784938336.429908:0:16301:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+16:2355:x1871643048801280:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1784938336.429925:0:16301:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1784938336.429933:0:16301:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 16 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.429947:0:16301:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 16 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.429995:0:16301:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:0.0:1784938336.430002:0:16301:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.430013:0:16301:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.430022:0:16301:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.430044:0:16301:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1784938336.430110:0:16301:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+16:2355:x1871643048801280:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 202us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.430120:0:16301:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:1.0:1784938336.432405:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c600/0xea86628a8aec4d49 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897db1 expref: 15 pid: 14288 timeout: 645 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.432442:0:14288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aedc97480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14288:1871643065562624:192.168.201.58@tcp:104: 00010000:00010000:1.0:1784938336.432478:0:14288:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.432491:0:14288:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.432527:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938336.432802:0:14288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1784938336.432987:0:14288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1784938336.433041:0:14288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1784938336.433172:0:14288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee076680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14288:1871643065562880:192.168.201.158@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938336.433665:0:14288:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8ef6480 going to sleep for 11 seconds 00000100:00100000:0.0:1784938336.434130:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:1.0:1784938336.435415:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065562880 00000100:00100000:1.0:1784938336.435435:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065562880 00000100:00100000:1.0:1784938336.435502:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938336.435515:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14288:x1871643065562880:12345-192.168.201.158@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938336.435654:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff881c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14288:x1871643065562880:12345-192.168.201.158@tcp:1000:mdt00_000.0 Request processed in 141us (1527us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938336.435663:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 0 00000100:00100000:1.0:1784938336.436371:0:14288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee076680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14288:1871643065562880:192.168.201.158@tcp:1000:mdt00_000.0 00010000:00010000:2.0:1784938336.438255:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1784938336.438424:0:14288:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1784938336.438569:0:14288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05aee076680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14288:1871643065563008:192.168.201.158@tcp:1000:mdt00_000.0 00000100:00100000:1.0:1784938336.438727:0:14288:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05ac8710780 going to sleep for 11 seconds 00000100:00100000:3.0:1784938336.441732:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:2.0:1784938336.444296:0:14293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065563008 00000100:00100000:2.0:1784938336.444316:0:14293:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065563008 00000100:00100000:2.0:1784938336.444388:0:14293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784938336.444398:0:14293:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14288:x1871643065563008:12345-192.168.201.158@tcp:1000:mdt00_000.0 00000100:00100000:2.0:1784938336.445444:0:14293:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14288:x1871643065563008:12345-192.168.201.158@tcp:1000:mdt00_000.0 Request processed in 1042us (3725us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1784938336.445459:0:14293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 1 00000100:00100000:2.0:1784938336.449861:0:14288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05aee076680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14288:1871643065563008:192.168.201.158@tcp:1000:mdt00_000.0 00010000:00010000:2.0:1784938336.449934:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.449946:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.449955:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.449962:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c400 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938336.449986:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.449996:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450016:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:2.0:1784938336.450020:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938336.450026:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450032:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c400/0xea86628a8aec4d81 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450076:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450083:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450088:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450105:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac8990200 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938336.450108:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450114:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450123:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938336.450125:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1784938336.450137:0:14288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 18 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450151:0:14288:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 18 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450162:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 18 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.450532:0:14288:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac6837400/0xea86628a8aec4ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0xcbec0c397a897d95 expref: 18 pid: 15342 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.450551:0:14288:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14288:1871643065563136:192.168.201.58@tcp:105: 00000100:00100000:2.0:1784938336.450653:0:14288:0:(client.c:2702:ptlrpc_set_wait()) set ffffa05afbe5da80 going to sleep for 11 seconds 00000100:00100000:1.0:1784938336.457079:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.457208:0:14288:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14288:1871643065563136:192.168.201.58@tcp:105: 00010000:00010000:2.0:1784938336.457286:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457298:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05ac8990200/0xea86628a8aec4cd9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14290 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457342:0:14288:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457359:0:14288:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457371:0:14288:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457401:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457407:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457414:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457420:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938336.457424:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457432:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457445:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938336.457449:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1784938336.457452:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457458:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05afc893e00/0xea86628a8aec4d88 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457468:0:14288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457475:0:14288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457481:0:14288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457490:0:14288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87c800 already unused, calling callback (ffffffffc220a4f0) 00010000:00010000:2.0:1784938336.457492:0:14288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457497:0:14288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457505:0:14288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffffa05ad886bc00) 00010000:00010000:2.0:1784938336.457507:0:14288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1784938336.457511:0:14288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.457516:0:14288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87c800/0xea86628a8aec4d7a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14288 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.457800:0:14288:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff882680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+18:14453:x1871643048801152:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 37142us (37787us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1784938336.457812:0:14288:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000020:00080000:2.0:1784938336.457821:0:14288:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1784938336.457912:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048801408 00000100:00100000:0.0:1784938336.457921:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048801408 00000100:00100000:0.0:1784938336.457971:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1784938336.457978:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05afc8ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+18:14452:x1871643048801408:12345-192.168.201.58@tcp:49:dd.0 00000100:00100000:0.0:1784938336.458086:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05afc8ac850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+18:14452:x1871643048801408:12345-192.168.201.58@tcp:49:dd.0 Request processed in 108us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938336.458110:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000040:00080000:1.0:1784938336.458458:0:14322:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1784938336.458463:0:14322:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1784938336.458484:0:14322:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1784938336.458490:0:14322:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1784938336.465374:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.465601:0:14292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048801664 00000100:00100000:3.0:1784938336.465701:0:14292:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048801664 00000100:00100000:3.0:1784938336.465869:0:14292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:3.0:1784938336.465881:0:14292:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+18:14453:x1871643048801664:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1784938336.467399:0:14292:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1784938336.468164:0:14292:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1784938336.468927:0:14292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.468952:0:14292:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.468982:0:14292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.468992:0:14292:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.468998:0:14292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.469004:0:14292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.469592:0:14292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1784938336.469956:0:14292:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff880000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:fab6306c-39cb-46f6-95e0-7a5423945d94+20:14453:x1871643048801664:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 4069us (4588us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1784938336.469969:0:14292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000020:00080000:3.0:1784938336.469977:0:14292:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1784938336.471344:0:14277:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1784938336.471358:0:14277:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.471370:0:14277:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87ce00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938336.471397:0:14277:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.471409:0:14277:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.471431:0:14277:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffffa05ac7d19900) 00010000:00010000:0.0:1784938336.471434:0:14277:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1784938336.471440:0:14277:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.471446:0:14277:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffffa05aff87ce00/0xea86628a8aec4d8f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14292 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.471465:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938336.471467:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1784938336.471469:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1784938336.606403:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1784938336.606675:0:14929:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048801792 00000100:00100000:2.0:1784938336.606691:0:14929:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048801792 00000100:00100000:2.0:1784938336.606783:0:14929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1784938336.606795:0:14929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+7:2355:x1871643048801792:12345-192.168.201.58@tcp:4:dd.0 00002000:00010000:2.0:1784938336.606864:0:14929:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a63ff61, atime: 0x6a63ff60, ctime: 0x6a63ff61, blocks: 0x1 00010000:00010000:2.0:1784938336.606875:0:14929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.606895:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=545s v=(0 0) 00010000:00010000:2.0:1784938336.606907:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938336.606916:0:14929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.606934:0:14929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.611055:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.611429:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.611476:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.611489:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.611501:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.611513:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1784938336.611527:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938336.611598:0:14930:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1784938336.611609:0:14930:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1784938336.612381:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612403:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048801920 00000100:00100000:2.0:1784938336.612415:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048801920 00000100:00100000:2.0:1784938336.612480:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612487:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802176 00000100:00100000:2.0:1784938336.612490:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802176 00000100:00100000:2.0:1784938336.612505:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612511:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802048 00000100:00100000:2.0:1784938336.612513:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802048 00000100:00100000:2.0:1784938336.612525:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612529:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802304 00000100:00100000:2.0:1784938336.612531:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802304 00000100:00100000:2.0:1784938336.612543:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612548:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802560 00000100:00100000:2.0:1784938336.612550:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802560 00000100:00100000:2.0:1784938336.612561:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612566:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802432 00000100:00100000:2.0:1784938336.612569:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802432 00000100:00100000:2.0:1784938336.612581:0:14931:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1784938336.612587:0:14931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802688 00000100:00100000:2.0:1784938336.612589:0:14931:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802688 00000100:00100000:3.0:1784938336.614917:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:3.0:1784938336.614945:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+15:2355:x1871643048801920:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:3.0:1784938336.615004:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.615028:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938336.615033:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1784938336.615041:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1784938336.615068:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938336.747883:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:2.0:1784938336.747903:0:16414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00000001:00080000:1.0:1784938336.747906:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1784938336.747918:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00002000:00010000:2.0:1784938336.747928:0:16414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:2.0:1784938336.747948:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.747976:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.747985:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.747993:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05aff87d200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938336.747998:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.748008:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.748029:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.748038:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086a6c596/0xea86628a8aec4d9d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.748150:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+13:2355:x1871643048801920:12345-192.168.201.58@tcp:4:dd.0 Request processed in 133210us (137106us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1784938336.748160:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1784938336.748191:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1784938336.748201:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+12:2356:x1871643048802176:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:2.0:1784938336.748275:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.748293:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938336.748297:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938336.748304:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.748316:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.752978:0:14929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.753004:0:14929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.753014:0:14929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.753021:0:14929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893e00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938336.753027:0:14929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.753038:0:14929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.753098:0:14929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.753108:0:14929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000f22d4ec/0xea86628a8aec4d96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.762802:0:14929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+12:2355:x1871643048801792:12345-192.168.201.58@tcp:4:dd.0 Request processed in 155986us (156393us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1784938336.762829:0:14929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1784938336.762882:0:14929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1784938336.762897:0:14929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+11:2355:x1871643048802048:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:1.0:1784938336.762951:0:14929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.762973:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.762978:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.762986:0:14929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.763003:0:14929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938336.838383:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1784938336.838489:0:16414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 4194304 00002000:00010000:0.0:1784938336.838494:0:16414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:0.0:1784938336.838509:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838521:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838529:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838536:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938336.838551:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838560:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838580:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838608:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4da4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1784938336.838720:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+13:2356:x1871643048802176:12345-192.168.201.58@tcp:4:dd.0 Request processed in 90516us (227286us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1784938336.838734:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1784938336.838769:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1784938336.838781:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+12:2355:x1871643048802304:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1784938336.838814:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838827:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938336.838831:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1784938336.838836:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.838848:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1784938336.873380:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:2.0:1784938336.873846:0:14929:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 4194304 -> 5242880 00002000:00010000:2.0:1784938336.873852:0:14929:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:2.0:1784938336.873867:0:14929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.873880:0:14929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.873889:0:14929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.873897:0:14929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1481a00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938336.873902:0:14929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.873912:0:14929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.873947:0:14929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.873955:0:14929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000277e40d3/0xea86628a8aec4dab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938336.874056:0:14929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+12:2355:x1871643048802048:12345-192.168.201.58@tcp:4:dd.0 Request processed in 111160us (262574us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1784938336.874067:0:14929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1784938336.874109:0:14929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:2.0:1784938336.874120:0:14929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+11:2355:x1871643048802560:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:2.0:1784938336.874158:0:14929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.874182:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938336.874186:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1784938336.874192:0:14929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938336.874204:0:14929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1784938336.916374:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00002000:00010000:0.0:1784938336.920209:0:16414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7340032 00002000:00010000:0.0:1784938336.920232:0:16414:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:0.0:1784938336.920251:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.920289:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.920299:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.920307:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac6836400 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:0.0:1784938336.920314:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.920325:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.920348:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1784938336.920356:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029e6644e/0xea86628a8aec4db2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.926916:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+11:2355:x1871643048802304:12345-192.168.201.58@tcp:4:dd.0 Request processed in 88060us (315346us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1784938336.926951:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1784938336.927069:0:16414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1784938336.927093:0:16414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+10:2356:x1871643048802432:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:1.0:1784938336.927139:0:16414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.927158:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.927162:0:16414:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.927169:0:16414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.927185:0:16414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1784938336.983896:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:1.0:1784938336.987461:0:14929:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1784938336.987494:0:14929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.987507:0:14929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.987516:0:14929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.987523:0:14929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05afc893200 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:1.0:1784938336.987529:0:14929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.987546:0:14929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.987566:0:14929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.987574:0:14929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a638432/0xea86628a8aec4db9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1784938336.987837:0:14929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+10:2355:x1871643048802560:12345-192.168.201.58@tcp:4:dd.0 Request processed in 113714us (376328us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1784938336.987911:0:14929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1784938336.987947:0:14929:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1784938336.987960:0:14929:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aee077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+9:2356:x1871643048802688:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:1.0:1784938336.988057:0:14929:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.988071:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.988076:0:14929:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1784938336.988091:0:14929:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1784938336.988104:0:14929:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1784938337.020591:0:16414:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00010000:00010000:2.0:1784938337.020612:0:16414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.020636:0:16414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.020643:0:16414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.020647:0:16414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1480000 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938337.020650:0:16414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.020657:0:16414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.020682:0:16414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.020687:0:16414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ff0221b6/0xea86628a8aec4dc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938337.020791:0:16414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee076a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+11:2356:x1871643048802432:12345-192.168.201.58@tcp:4:dd.0 Request processed in 93707us (409270us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1784938337.020802:0:16414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000001:00080000:2.0:1784938337.020842:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00000001:00080000:2.0:1784938337.048271:0:6628:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:2.0:1784938337.048609:0:14929:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1784938337.048639:0:14929:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.048652:0:14929:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.048661:0:14929:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.048679:0:14929:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffffa05ac1481c00 already unused, calling callback (ffffffffc17ec4a0) 00010000:00010000:2.0:1784938337.048685:0:14929:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.048971:0:14929:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.049112:0:14929:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1784938337.049122:0:14929:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004f487364/0xea86628a8aec4dc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14929 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1784938337.049293:0:14929:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aee077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2356:x1871643048802688:12345-192.168.201.58@tcp:4:dd.0 Request processed in 61332us (437758us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1784938337.049304:0:14929:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00010000:00010000:2.0:1784938337.457431:0:14276:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1784938338.486836:0:15346:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1784938338.865714:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffffa05ae168a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065563264:192.168.201.158@tcp:13:osp-pre-0-0.0 00000100:00100000:3.0:1784938338.868561:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.158@tcp (source: 12345-192.168.201.158@tcp) 00000100:00100000:3.0:1784938338.868625:0:14928:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643065563264 00000100:00100000:3.0:1784938338.868637:0:14928:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643065563264 00000100:00100000:3.0:1784938338.868733:0:14928:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00100000:3.0:1784938338.868746:0:14928:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065563264:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 00002000:00000024:3.0:1784938338.868804:0:14928:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1784938338.868886:0:14928:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1871643065563264:12345-192.168.201.158@tcp:13:osp-pre-0-0.0 Request processed in 143us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938338.868894:0:14928:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.158@tcp, seq: 14 00000100:00080000:2.0:1784938338.874824:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1784938338.877296:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:1.0:1784938338.877310:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffffa05ae1689c00, transno 8589934596 00000004:00080000:1.0:1784938338.877334:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1784938338.877386:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffffa05ae168a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3322:1871643065563264:192.168.201.158@tcp:13:osp-pre-0-0.0 00000001:02000400:0.0:1784938338.899650:0:16454:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:3.0:1784938339.250767:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.250821:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.250860:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.250903:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.250926:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.250946:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.250968:0:3314:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1784938339.251012:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048803200 00000100:00100000:3.0:1784938339.251025:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048803200 00000100:00100000:3.0:1784938339.251106:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048803456 00000100:00100000:3.0:1784938339.251109:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048803456 00000100:00100000:3.0:1784938339.251130:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048803072 00000100:00100000:3.0:1784938339.251132:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048803072 00000100:00100000:3.0:1784938339.251173:0:14924:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048803584 00000100:00100000:3.0:1784938339.251176:0:14924:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048803584 00000100:00100000:3.0:1784938339.251194:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784938339.251274:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2358:x1871643048803200:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938339.251379:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2358:x1871643048803200:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 163us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938339.251388:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1784938339.251408:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784938339.251415:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cedbaae-217c-4297-ba4f-37266cedd843+5:2358:x1871643048803456:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938339.251441:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cedbaae-217c-4297-ba4f-37266cedd843+5:2358:x1871643048803456:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938339.251447:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1784938339.251458:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784938339.251465:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2358:x1871643048803072:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938339.251489:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:fab6306c-39cb-46f6-95e0-7a5423945d94+5:2358:x1871643048803072:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938339.251496:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1784938339.251506:0:14924:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:3.0:1784938339.251513:0:14924:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cedbaae-217c-4297-ba4f-37266cedd843+5:2358:x1871643048803584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1784938339.251541:0:14924:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05ac8229180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8cedbaae-217c-4297-ba4f-37266cedd843+5:2358:x1871643048803584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1784938339.251548:0:14924:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1784938339.251800:0:14282:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802816 00000100:00100000:1.0:1784938339.251806:0:14282:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802816 00000100:00100000:1.0:1784938339.251849:0:14282:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:1.0:1784938339.251857:0:14282:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aff9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2358:x1871643048802816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1784938339.251909:0:14282:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aff9d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:6c312038-c6a3-4205-976c-ee5db1f0f6fd+13:2358:x1871643048802816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 53us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1784938339.251917:0:14282:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00080000:2.0:1784938339.252063:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1784938339.252069:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1784938339.252464:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048802944 00000100:00100000:0.0:1784938339.252470:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048802944 00000100:00100000:0.0:1784938339.252529:0:15342:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1871643048803328 00000100:00100000:0.0:1784938339.252532:0:15342:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1871643048803328 00000100:00100000:0.0:1784938339.252557:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784938339.252564:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05aedc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+20:2358:x1871643048802944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938339.252625:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05aedc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:fab6306c-39cb-46f6-95e0-7a5423945d94+20:2358:x1871643048802944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 61us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938339.252632:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1784938339.252647:0:15342:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1784938339.252653:0:15342:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffffa05b01ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2358:x1871643048803328:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1784938339.252681:0:15342:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffffa05b01ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8cedbaae-217c-4297-ba4f-37266cedd843+6:2358:x1871643048803328:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (1733us total) trans 0 rc 0/0 00000100:00100000:0.0:1784938339.252687:0:15342:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00080000:2.0:1784938339.253112:0:14284:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1784938339.505432:0:14277:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29853 lines, 29853 kept, 0 dropped, 0 bad.